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The study of multidimensional stochastic processes involves com- 
plex computations in intricate functional spaces. In particular, the 
diffusion processes, which include the practically important Gauss- 
Markov processes, are ordinarily defined through the theory of stochas- 
tic integration. Here, inspired by the Levy-Ciesielski construction of 
the Wiener process, we propose an alternative representation of mul- 
tidimensional Gauss-Markov processes as expansions on well-chosen 
Schauder bases, with independent random coefficients of normal law 
with zero mean and unitary variance. We thereby offer a natural 
multi-resolution description of Gauss-Markov processes as limits of 
the finite-dimensional partial sums of the expansion, that are strongly 
almost-surely convergent. Moreover, such finite-dimensional random 
processes constitute an optimal approximation of the process, in the 
sense of minimizing the associated Dirichlet energy under interpo- 
lating constraints. This approach allows simpler treatment in many 
applied and theoretical fields and we provide a short overview of ap- 
plications we are currently developing. 



Introduction. Multidimensional continuous processes are easily defined 
for a wide range of stochastic equations through standard Ito integration 
theory (see e.g. [42]). However, studying their properties proves surprisingly 
challenging, even for the simplest multidimensional processes. The high di- 
mensionality of the ambient space and the nowhere-differentiability of the 
sample paths conspire to heighten the intricacy of the sample paths spaces. 
In this regard, such spaces have been chiefly studied for multidimensional 
diffusion processes [49], and more recently, the development of rough paths 
theory has attracted renewed interest in the field [6, 21, 37]. Aside from 
these remarkable theoretical works, little emphasis is put on the sample 
paths since most of the available results only make sense in distribution. 
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This is particularly true in Ito integration theory, where the sample path is 
completely neglected for the Ito map being defined up to null sets of paths. 
Adopting a discrete representation of a process that allows the inference of 
sample paths properties from finite-dimensional approximating processes, al- 
leviates the difficulty of working in multidimensional spaces. This is achieved 
through writing a process X as an almost-sure path-wise convergent series 
of random functions 

N 

Xt = hm Xn with Xn = fn{t) ■ Hn , 

N-^oo '-^ 

n=0 

where the /„ are deterministic functions and the H„ are independently iden- 
tically distributed random variables. 

The Levy-Cesielski construction of the d-dimensional Brownian motion W 
(also referred as Wiener process) provides us with an example of discrete 
representation for a continuous stochastic process [36]. Noticing the simple 
form of the probability density of a Brownian bridge, it is based on complet- 
ing sample paths by interpolation according to the conditional probabilities 
of the Wiener process. More specifically, the coefficients H„ are Gaussian 
independent and the elements /„, called Schauder elements and denoted 
s„, are obtained by time-dependent integration of the Haar basis elements: 
So,o(*) =tld and Sn,A:(t) = Sn,fc(i) J-d, with for all n > 

r 2"^ (t - /„,fc) , ^2-^^! < t < (2A:+ 1)2-" , 
Sn,k{t) = I 2^{rn,k - t) , (2A:+1)2-" < t < (A; + l)2-"+i , 
, otherwise . 

This latter point is of relevance since, for being a Hilbert system, the in- 
troduction of the Haar basis greatly simplify the demonstration of the ex- 
istence of the Wiener process [11]. It is also important for our purpose to 
realize that the Schauder elements s„ have compact supports that exhibits 
a nested structure: this fact entails that the finite sums Wn are processes 
that interpolates the limit process W on the endpoints of the supports, 
i.e. on the dyadic points k2~^ , < k < 2^ . One of the specific goal of 
our construction is to maintain such a property in the construction of all 
multidimensional Gauss-Markov processes X, being successively approxi- 
mated by finite dimensional processes that interpolates X at ever finer 
resolution. In that respect, , it is only in that sense that we refer to our 
framework as a multi-resolution approach as opposed to the wavelet multi- 
resolution theory [38] . Extensions of this method to the fractional Brownian 
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motion were also developed [40], but applied to some very specific processes. 

In view of this, we propose a construction of multidimensional Gaussian 
Markov processes using a multi-resolution Schauder basis of functions. As 
for the Levy-Ciesielski construction, our basis is not made of orthogonal 
functions but the elements are such that the random coefficients H.„ are 
always independent and Gaussian (for convenience with law J\f{0,ld), i.e. 
with zero mean and unitary variance) . We first develop a heuristic approach 
for the construction of stochastic processes reminiscent of the midpoint dis- 
placement technique [11, 36], before rigorously deriving the multi-resolution 
basis that we will be using in all the paper. This set of functions is then 
studied as a multi-resolution Schauder basis of functions: in particular, we 
derive explicitly from the multi-resolution basis an Haar-like Hilbert basis, 
which is the underlying structure explaining the dual relationship between 
basis elements and coefficients. Based on these results, we study the con- 
struction application and its inverse, the coefficient applications, that relate 
coefficients on the Schauder basis to sample paths. We pursue by proving 
the almost sure and strong convergence of the process having independent 
standard normal coefficients on the Schauder basis to a Gauss-Markov pro- 
cess. We also show that our decomposition is optimal in some sense that is 
strongly evocative of spline interpolation theory [15]: the construction yields 
successive interpolations of the process at the interval endpoints that min- 
imizes the Dirichlet energy induced by the differential operator associated 
with the Gauss-Markov process [22, 41]. We also provide a series of examples 
for which the proposed Schauder framework yields bases of functions that 
have simple closed form formulae: in addition to the simple one-dimensional 
Markov processes, we explicit our framework for two classes of multidimen- 
sional processes, the Gauss-Markov rotations and the iteratively integrated 
Wiener processes (see e.g [25, 35, 39]). 

The ideas underlying this work can be directly traced back to the origi- 
nal work of Levy. Here, we intend to develop a self-contained Schauder dual 
framework to further the description of multidimensional Gauss-Markov pro- 
cesses, and in doing so, we extend some well-known results of interpolation 
theory in signal processing [16, 31, 32]. To our knowledge, such an approach 
is yet to be proposed. By restraining our attention to Gauss-Markov pro- 
cesses, we obviously do not pretend to generality. However, we hope our 
construction proves of interest for a number of points, which we tentatively 
list in the following. First, the almost-sure path- wise convergence of our con- 
struction together with the interpolation property of the finite sums allows 
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to reformulate results of stochastic integration in term of the geometry of 
finite-dimensional sample paths. In this regard, we found it appropriate to 
illustrate how in our framework, the Girsanov theorem for Gauss-Markov 
processes appears as a direct consequence of the finite-dimensional change 
of variable formula. Second, the characterization of our Schauder elements 
as the minimizer of a Dirichlet form paves the way to the construction of 
infinite-dimensionel Gauss-Markov processes, i.e. processes whose sample 
points themselves are infinite dimensional [12, 33]. Third, our construction 
shows that approximating a Gaussian process by a sequence of interpolating 
processes relies entirely on the existence of a regular triangularization of the 
covariance operator, suggesting to further investigate this property for non- 
Markov Gaussian processes [28] . Finally, there is a number of practical ap- 
plications where applying the Schauder basis framework clearly provides an 
advantage compared to standard stochastic calculus methods, among which 
first-hitting times of stochastic processes, pricing of multidimensional path- 
dependant options [3-5, 23], regularization technique for support vector ma- 
chine learning [47] and more theoretical work on uncovering the differential 
geometry structure of the space of Gauss-Markov stochastic processes [48]. 
We conclude our exposition by developing in more details some of these 
direct implications which will be the subjects of forthcoming papers. 

1. Rationale of the Construction. In order to provide a discrete 
multi-resolution description of Gauss-Markov processes, we first establish 
basic results about the law of Gauss-Markov bridges in the multidimensional 
setting. We then use them to infer the candidate expressions for our desired 
bases of functions, while imposing its elements to be compactly supported 
on a nested sequence segments. Throughout this article, we are working in 
an underlying probability space (Jl, J^, P). 

1.1. Multidimensional Gauss-Markov Processes. After recalling the def- 
inition of multidimensional Gauss-Markov processes in terms of stochastic 
integral, we use the well known conditioning formula for Gaussian vectors 
to characterize the law of Gauss-Markov bridge processes. 

1.1.1. Notations and Definitions. Let (W^, J-^, t G [0, 1]) be a m-dimensional 
Wiener process, consider the continuous functions a : [0, 1] — )■ M"'^'^ : 
[0, 1] — )• M"^^"^ and define the positive bounded continuous function T = 
\/V ■ \/V : [0, 1] —7- M'^^'^. The d-dimensional Ornstein-Uhlenbeck process 
associated with these parameters is solution of the equation 



(1.1) 



dXt = cx{t)-Xt + ^/V{t)-dWt, 
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and with initial condition Xt^ in to, it reads 

(1.2) Xt = F{to, t) ■ Xt, + F{to, t) ■ f F{s, to) ■ ^/t{s) ■ dW^ , 

-'to 

where F{to,t) is the flow of the equation, namely the solution in W^^'^ of 
the linear equation: 

(dF{to,t) 



(1.3) 



dt 

F{to,to) =1, 



a{t)F{t) 



Note that the flow ^{to,t) enjoys the chain rule property: 

F{to,t)=F{ti,t)-F{to,ti). 
For all t, s such that to < s, t, the vectors Xt and Xg admit the covariance 



Ct,{s,t) = F{to,t)(^j^ F{w,to)T{w)F{w,tof dv?j F{to,sf 

(1.4) = F{to,t)ht,{s,t)F{to,sf 
where we further defined hu{s,t) the function 

hu{s, t)= I F{w, u) ■ T{w) ■ F{w, uf dw 

J s 

which will be of particular interest in the sequel. Note that because of the 
chain rule property of the flow, we have: 

(1.5) h^{s, t) = F{v, u) huis, t) F{v, uf 

We suppose that the process X is never degenerated, that is, for all to < < 
V, all the components of the vector X^, knowing X^ are non-deterministic 
random variables, which is equivalent to say that the covariance matrix of Xy 
knowing X^, denoted Cu{v,v) is symmetric positive definite for any u ^ v. 
Therefore, assuming the initial condition Xq = 0, the multidimensional 
centered process X has a representation (similar to Doob's representation 
for one-dimensional processes, see [29]) of form: 



Xt = g{t) f f{s) ■ dWs 
Jo 



with g{t) = F{0,t) and f{t) = F{t,0) ■ ^/^(t). 

Note that the processes considered in this paper are defined on the time 
interval [0, 1]. However, because of the time-rescaling property of these pro- 
cesses, considering the processes on this time interval is equivalent to consid- 
ering the process on any other bounded interval without loss of generality. 
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1.1.2. Conditional Law and Gauss-Markov Bridges . As stated in the 
introduction, we aim at defining a multi-resolution description of Gauss- 
Markov processes. Such a description can be seen as a multi-resolution in- 
terpolation of the process that is getting increasingly finer. This principle, 
in addition to the Markov property, prescribes to characterize the law of the 
corresponding Gauss-Markov bridge, i.e. the Gauss-Markov process under 
consideration, conditioned on its initial and final values. The bridge process 
of Gauss process is still a Gauss process and, for a Markov process, its law 
can be computed as follows: 

Proposition 1. Let t^ < tz two times in the interval [0,1]. For any 
t S [tx,tz], the random variable conditioned on X^^ = x and Xt^ = z 
is a Gaussian variable with covariance matrix and mean vector fj,{t) 
given by: 



where the continuous matrix functions tx, tz) and /x''(-; tx, tz) ofW^^ 
are given by: 



Note that the functions fi and fi^' have the property that fJ, {tx] tx, tz) = 
t^^'itz] tx, tz) = Id and fi^{tz; tx, tz) = fJ-^'itx; tx, tz) = ensuring that the 
process is indeed equal to x at time tx and z at time tz- 

Proof. Let tx, tz be two times of the interval [0, 1] such that tx < tz, 
and let t £ [tx,tz]- We consider the Gaussian random variable ^ = (Xt, Xt^ ) 
conditioned on the fact that Xt^ = x. Its mean can be easily computed from 
the expression (1.2) and reads: 



{mt,mtj = {F{tx,t)x,F{tx,tz)x) = {g{t)g ^{tx) x,g{tz) g ^{tx)x) , 



5](t; tx, tz) 

Kt) 



ht(tx,t){ht{tx,tz)) ht{t,tz) , 
tx, tz)-x + n''{t; tx, tz) ■ z 




and its covariance matrix, from equation (1.4), reads: 



F{tx, t)ht^ {tx, t)F{tx, t)'^ F{tx, t)htStx,t)F{tx,tz)'^ 
F{tx,tz)ht^ {tx, t)F{tx, i)^ F{tx, tz)ht^{tx,tz)F{tx,tz) 



T "1 



T 



ht{tx,t) ht{tx,t)F{t,tz)'^ 

F{t, tz) ht{tx, t) F{t, tz) ht{tx,tz) F{t, tz)^ 
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From there, we apply the conditioning formula for Gaussian vectors (see 
e.g. [7]) to infer the law of Xt conditionned on Xt^ = x and Xt^ = z, that 
is the law N'{fJ,{t),Yl{t;tx,tz)) of Bt where B denotes the bridge process 
obtained by pinning X in and t^. The covariance matrix is given by 

= ht{tx,t) - ht{tx,t) {ht{tx,tz)r^ ht{tx,t) , 
= ht{tx,t){ht{tx,tz)y^ ht{t,tz) , 

and the mean reads 

H{t) = my + Cy^zC'l {z - ruz) 

= F{tx,t){ld-ht^{tx,t){ht^{tx,tz))-^) X 

+F{tz,t)htJtx,t){htStx,tz))-^ z, 
= F{tx,t) ht^ (t, tz) {ht^ (tx,tz)r^ • X 

' V ' 

/J' {tj txi tz) 

+F{tz, t)ht^ {tx,t) {ht^{tx,tz)y^ ■ z , 

' V ' 

fj,''it;tx,tz) 

where we have used the fact that ht^{tx,tz) = ht^{tx,t) + ht^{t,tz)- The 
regularity of the thus-defined functions fix and /x^ directly stems from the 
regularity of the fiow operator F. Moreover, since for any < t,n < 1, we 
observe that F{t, t) = Id and t) = 0, we clearly have fJ^x{tx) = f^yit) = 
Id and fixit) = fJ-yitx) = 0. □ 

Remark 1. Note that these laws can also be computed using the expres- 
sion of the density of the processes, but involves more intricate calculations. 
Moreover, this approach allows to compute the probability distribution of 
the Gauss-Markov bridge as a process (i.e allows to compute the covari- 
ances), but since this will be of no use in the sequel, we do not provide the 
expressions. 

1.2. The Multi-Resolution Description of Gauss-Markov processes. Rec- 
ognizing the Gauss property and the Markov property as the two crucial 
elements for a stochastic process to be expanded a la Levy-Cesielsky, our 
approach first supposes to exhibit bases of deterministic functions that would 
play the role of the Schauder bases for the Wiener process. In this regard, 
we first expect such functions to be continuous and compactly supported on 
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increasingly finer supports (i.e. sub-intervals of the definition interval [0, 1]) 
in a similar nested binary tree structure. Then, as in the Levy-Cesielsky 
construction, we envision that, at each resolution (i.e. on each support), 
the partially constructed process (up to the resolution of the support) has 
the same conditional expectation as the Gauss-Markov process when con- 
ditioned on the endpoints of the supports. The partial sums obtained with 
independent Gaussian coefficients of law M{0, 1) will thus approximate the 
targeted Gauss-Markov process in a multi-resolution fashion, in the sense 
that, at every resolution, considering these two processes on the intervals 
endpoints yields finite-dimensional Gaussian vectors of same law. 

1.2.1. Nested Structure of the Sequence of Supports. Here, we define 
the nested sequence of segments that constitute the supports of the multi- 
resolution basis. We construct such a sequence by recursively partitioning 
the interval [0, 1]. 

More precisely, starting from 5i^o = [^i.Oi'^i.o] with ^i^o = and n^o = 1) 
we iteratively apply the following operation. Suppose that, at the nth step, 
the interval [0,1] is decomposed into 2""^ intervals Sn,k = [ln,k,rn,k], called 
supports, such that ln,k+i = fn,k for < /c < 2"~^. Each of these intervals is 
then subdivided into two child intervals, a left child Sn+i,2k and a right child 
S'„+i,2fc+i, and the subdivision point rn+i,2k = ln+i,2k+i is denoted mn,k- 
Therefore, we have defined three sequences of real ln,k-, i^ri,k-, and rn,k for 
n > and < A; < 2"^^ satisfying /o,o = < In^k < ^i'n,k < fn,k < '^o.o = 1 
and 

ln+l,2k = ln,k, ^n,k = ^n+l,2fc = ^n+l,2fc+l) '"n+l,2fc+l = ^n,k ■ 

where we have posit /o,o = and ro,o = 1 and 5o,o = [0, 1]. The resulting 
sequence of supports {Sn,k ]n < 0, < k < 2""^} clearly has a binary tree 
structure. 

For the sake of compactness of notations, we define I the set of indices 



and for > 0, we define Djy = {run^k > {n-, k) E In-i} U {0, 1}, the set of 
endpoints of the intervals SN,k- We additionally require that there exists p € 
(0, 1) such that for all (n, k) G I max(r„^fc - mn,k, m^^k - ln,k) < p{rn,k - ln,k) 
which in particular implies that 




In = {in,k) e \ < n < N , 0<k< 2""^} 



n<N 



lim supr„,fc 




= 0. 
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Fig 1 . A sequence of nested intervals 



and ensures that the set of endpoints UArgN-DAr is dense m [0, 1]. The simplest 
case of such partitions is the dyadic partition of [0, 1], where the end points 
for (n, k) £ I read 

ln,k = k 2-"+i, mn,k = {2k + 1)2-", rn,k = {k + l)2-"+i . 

in which case the endpoints are simply the dyadic points UatDtv = {k2^^ \ < 
k < 2^}. Figure 1 represents the global architecture of the nested sequence 
of intervals. 

The nested structure of the supports, together with constraint of continu- 
ity of the bases elements, implies that only a finite number of coefficients are 
needed to construct the exact value of the process at a given endpoints, thus 
providing us with an exact schema to simulate sample values of the process 
on the endpoint up to an arbitrary resolution, as we will further explore. 

1.2.2. Innovation processes for Gauss-Markov processes. For Xt a mul- 
tidimensional Gauss-Markov process, we call multi-resolution description 
of a process the sequence of conditional expectations on the nested sets 
of endpoints Dn- In details, if we denote J-'n the filtration generated by 
{Xt;t G Djy} the values of the process at the endpoints Dj\[ of the par- 
tition, we introduce the sequence of Gaussian processes {Z^)n>i defined 
by: 
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These processes constitute a martingale taking values in the processes 
spaces that can be naturally viewed as an interpolation of the process X 
sampled at the increasingly finer partitions timesDAr, since for all t G D^v 
we have = . The innovation process {d^ ,Tt,t e [0, 1]) is defined as 



the update transforming the process Z^ into Z^ 



, I.e. 



(1.6) 



iN 



N+l 



rN 



It corresponds to the difference the additional knowledge of the process at 
the points mp^^k niake on the conditional expectation of the process. This 
process satisfies the following important properties that found our multi- 
resolution construction 

Proposition 2. The innovation process 5^^ is a centered Gaussian pro- 
cess independent of the processes Z^ for any n < N . For s G S^.k o^nd 
t £ Sn,p with k,p Im, the covariance of the innovation process reads: 



(1.7) 
where 



K 



N 



«5f • {s^f 



fJ-N,k{'t) ■ ^N,k ■ fJ'N,k{t) ifk=p 
tfk^p, 



lJ'N,k{t) 



fJ'^ {t', lN,k, mN,k) t G [^N,k,nT'N,k] 

^n'-{t; mN,k, rN,k) t G [mN,k,rN,k]- 

with ii\ fi^ and XIat^a; = Ti{mi^y,lj<i±,rj<[^k) as defined in Proposition 1. 



Proof. Because of the Markovian property of the process X, the law 
of the process Z^ can be computed from the bridge formula derived in 
Proposition 1 and we have: 



rN 



fJ-^t; l^^k, rN,k) ■ XlMk + t^^i^'^ ^N,k, rN,k) ■ X. 



rN,k ■ 



and 



mH*; ^N,k, I^N^k) ■ ^lN,k + f^^i^'y ^N,k, 1TT-N,k) ' 
for t e [lN,k,mN,k] , 



wN+1 



fj,'-{t; mN,k, r^^it) ■ X^^^, + ti''{t\ m^r^fc, r^r^fc) • X^^^. , 
for t £ [lN,k,mN,k] ■ 

Therefore, the innovation process can be written for t € Sj\f^k as 

5f = /xj^,,(t).X„_+^^(t).Qf 
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where is a Fn measurable process, v (t) a deterministic matrix function 
and 



f^'^it; lN,k, mjy^k) t £ [lN,k,mN,k] 

^/x'(t; mN,k, rN,k) t G [mN,k,rN,k]- 

The expressions of u and Q are quite complex, but are highly simplified 
when noting that 



]S[Zt\TN+l]\J^N 



E 




rN 



directly implying that u{t)-Q^ = {t)- ^ and yielding the remarkably 
compact expression: 

(1-8) 5f = • (X^^,, - Z^^ J . 

This process is a centered Gaussian process. Moreover, observing that it is 
J-AT-measurable, it can be written as: 

and the process {X^j^ ^ \^n} appears as the Gauss-Markov bridge condi- 
tioned at times lN,k and r^^k^ and whose covariance is given by Proposition 
1 and that has the expression 

'^N,k = '^{'mN,k'jN,k,rN,k) 
(1.9) = hm^Jl 

Let {s,t) £ [0,1]^, and assume that s E SN,k and t E Sn,p- k p, 
then because of the Markov property of the process X , the two bridges are 
independent and therefore the covariance E^r 6^^ • {S^)^ is zero. If k = p, 
we have: 



Si 



N 



tJ'N,k{t) ■ Stv^/,. • /XAr,fc(s) 



Eventually, the independence property stems from simple properties of the 
conditional expectation. Indeed, let n < N. We have: 



E 



N\T' 



wN+1 



N\T' 



E [E [Xt\J^n] ■ (E [xJ\Tn+i] - E [xJIJ^n])] 

E [E [Xt\Tn] ■ E [X^\Tn+i]] - E [E [Xt\Tn] • E [X^\Tn]] 

E[znZ^f]-E[Z^iZ-f] 
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and the fact that a zero covariance between two Gaussian processes impUes 
the independence of these processes concludes the proof. □ 

1.2.3. Derivation of the Candidate Multi-Resolution Bases of Functions. 
We deduce from the previous proposition the foUowing fundamental theorem 
of this paper 

Theorem 3. For all N gN, there exists a collection of functions ipN,k '■ 
[0, 1] ^ R'^'"^ that are zero outside the sub-interval SNk o-nd such that in 
distribution we have: 

where Hjy^fc are independent d- dimensional standard normal random vari- 
ables (i.e. of law J\f{0, Id))- This basis of functions is unique up to an or- 
thogonal transformation. 

Proof. The two processes and X^^gj^ tpN,k{t) ■ HAr,fc are two 

Gaussian processes of mean zero. Therefore, we are searching for functions 
fpN,k vanishing outside S^^k and ensuring that the two processes have the 
same probability distribution. A necessary and sufficient condition for the 
two processes to have the same probability distribution is to have the same 
covariance function (see e.g. [7]). We therefore need to show the existence 
of a collection of functions '4>N,k{t) functions that vanish outside the sub- 
interval Sjsi^k and that ensure that the covariance of the process is equal 
to the covariance of 6^ . Let G [0, 1] such that s S ^Arfc and t G S^^p. 
li k ^ p, the assumption fact that the functions ^N,k vanish outside S]\i^k 
implies that 

E [df . id^f] = 0. 
If k = p, the covariance reads: 

= i>N,k{t) ■ {ll^N,k{s) f 

which needs to be equal to the covariance of , namely: 
(1.10) 'lpN,k{t) ■ ('0Af,fc(s))^ = AtAr,fc(i) • '^N,k ■ ifJ'NM^))'^ ■ 

Therefore, since tJ'N,k{iT^N.k) = Id, we have: 

ipN,k{mN,k) ■ {il^N,k{mN,k)V = ^N,k 
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def 

meaning that cr^v^fc = 'ipN,k{^N,k) is a square root of the symmetric positive 
matrix Siv,fc- Moreover, by fixing s = m^^^^ in equation (1.10), we get: 



'^N,k{t) ■ ^N,k = t^{t) ■ ^N,k ■ (^N,k 

Eventually, since by assumption we have '^N^k invertible, so is ct^^^, and the 
functions ipN,k can be written as: 

(1-11) tpN,kit) = tJ-N^kit) ■ (TN,k 

with (T^^fc a square root of 'SN,k- Square roots of positive symmetric ma- 
trices are uniquely defined up to an orthogonal transformation. Therefore, 
all square roots of 'SN,k are related by orthogonal transformations o"^^ = 
(^N,k • 0]\f^k where Otv,^ • = Id- This property immediately extends to 
the functions tpN,k we are studying: two different functions tl^N,k and lA^fc 
satisfying the theorem differ from an orthogonal transformation O^^k- We 
proved that, for ipN,k(t) ■ Htv,^ to have the same law as (t) in the interval 
5'7v,fc, the function ij^N^k with support in Sj\f^k are necessarily of the form 
fJ'N,kii) '<^N,k- It is straightforward to show the sufficient condition that pro- 
vided such a set of functions, the processes 6^ and are equal in law, 
which ends the proof of the theorem. □ 

Using the expressions obtained in Proposition 1, we can make completely 
explicit the form of the basis in terms of the functions /, g and h. 
(1.12) 

g{t) g"^ {mn,k) hm„,^{ln,k,t) {hm„,^{{ln,k, mn,k)) (^n,k-, 
for ln,k <t< mn,k , 



tpn,ki^) = ' 



for rUnh < t < Tnh , 



and (Tn^k satisfies 

^n,k ■ ""n.fc ~ h,m„^kQ'n,ky'>^n,k) (^m„_fe (^n,fc5 ^n,fc)) hm„,.{mn^ki'''n,k) ■ 

Note that CTn^k can be defined uniquely as the symmetric positive square root, 
or as the lower triangular matrix resulting from the Cholesky decomposition 
of 

Let us now define the function i/jq.o : [0, 1] i— )• M'^^'^ such that the process 
■00,0 (i) "30,0 has the same covariance as Z^, which is computed using exactly 
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the same technique as developed in the proof of Theorem 3 and that has the 
expression 

"00,0(0 = g{t)ho{lofl,t) {ho{lo,o,ro,o)y^ 9'^{ro,o) (To,o , 

for CTg.o a square root of C^q q the covariance matrix of q which from 
equation (1.4) reads: 

F{0, l)^o(l, l)F{0, if = g{l)ho{l, l){g{l)f. 

We are now in position to show the fohowing corollary of Theorem 3 

Corollary 1. The Gauss-Markov process is equal in law to the 
process 

N-l 

n=0 fcGin 

where H„,^fc are independent standard normal random variables N{^, Id)- 
Proof. We have: 

Zf = (Zf - zf -1) + (zf -1 - zf + ... + {zj- z}) + z\ 

N-l 

= Y,s? + zi 



n=l 

N~l 

^ ^ ll^n,k{t) ■ Sn,k + V'0,o(i) • 3o,( 

n=l fceXn 

N-l 

n=0 fcein 



□ 



We therefore identified a collection of functions {i/'n,A;}(n,fc)ex that allows 
a simple construction of the Gauss-Markov process iteratively conditioned 
on increasingly finer partitions of the interval [0, 1] . We will show that this 
sequence Z^ converges almost surely towards the Gauss-Markov process Xt 
used to construct the basis, proving that these finite-dimensional continu- 
ous functions Z/^ form an asymptotically accurate description of the initial 
process. Beforehand, we rigorously study the Hilbertian properties of the 
collection of functions we just defined. 
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2. The Multi-Resolution Schauder Basis Framework. The above 
analysis motivates the introduction of a set of functions {tpn,k}{n,k)ex we now 
study in details. In particular, we enlighten the structure of the collection of 
functions a Schauder basis in a certain space X of continuous func- 

tions from [0, 1] to M°'. The Schauder structure was defined in [44, 45], and its 
essential characterization is the unique decomposition property: namely that 
every elements x in X can be written as a well-formed linear combination 

^ ^ '^n,k ' ^n,k j 
in,k)eX 

and that the coefficients satisfying the previous relation are unique. 

2.1. System of Dual Bases. To complete this program, we need to intro- 
duce some quantities that will play a crucial role in expressing the family 
ipn,k as a Schauder basis for some given space. In equation (1.12), two con- 
stant matrices M'^^'^ appear, that will have a particular importance in the 
sequel for (n, k) in X with n ^ 0: 

Ln,k = g'^imn,k){hm^i^{ln,k,mn,k)) ^ CTn,k 

= {h{ln,k->'f^n,k)) ^ {rrin^k) 0-n,k , 
Rn,k = Sf"^("^n,fc)(^m„^fc("ln,fei ''n,^)) "^""n.fe 

= {h{mn,k,rn,k)) ^ g~^imn,k) crn,k , 
where h stands for ^o- We further define the matrix 

Mn,k = g^ {mn,k) O-'j.^ 

and we recall that cr„ ^ is a square root of 5]„ fc, the covariance matrix of 
J. knowing Xi^^^^ and ^ given in equation (1.9). We stress that 
the matrices -Ln,fci Rn,k, Mn,k and 1^n,k are all invertible and satisfy the 
important following properties: 

Proposition 4. For all {n, k) inZ, 0, we have: 
i. Mn,k = Ln,k + Rn,k and 

ii- '^n!k= {^rn„,ki^n,k,'irin,k)y + (^m„,fc (m^^fc , ^n./c)) ~ • 

To prove this proposition, we first establish the following simple lemma of 
linear algebra: 
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Lemma 1. Given two invertible matrices A and B in GL„(M) such that 
C = A + B is also invertible, if we posit D = AC~^B, we have the following 
properties: 

i. D = AC-^B = BC^^A and 

a. D-^ = A-^ + B-^ 

Proof, i) D = AC-^B = (C - B)C^^B = B - BC'^B = B(I - 
C^^B) = BC~^{C -B) = BC^^A. 

ii) {A^^ + B~^)D = A-^D + B^^D = A^^ AC^^B + B-^BC~^ A = C^^iB + 
A) = C^^C = 1. □ 

Proof of Proposition 4. 
(ii) directly stems from Lemma 1, item (ii) by posing A = hm„ ki^ri,k,'m'n,k), 
^ = f^m„^kimn^k,rn,k) and C = A + B = hm„^Sn,k,rn,k)- Indeed, the lemma 
implies that 

= A^^CB^^ 



y;-l 

n,k 



(i) We have: 



Ln,k + Rn,k = g{mn,kV{h{ln,k,mn,k) ^ + H'mn,k,rn,k) ^)(Tn,k 

= g{mn,kf 

which ends the demonstration of the proposition. □ 

Let us define -Lo,o = (^(^o,Oi ''o.o))"^ Sf~^('^o,o) ""o.o- With this notations 
we define the functions in a compact form as: 

Definition 1. For every (n, k) in X with n 7^ 0, the continuous functions 
'4Jn,k are defined on their support Sn^k as 



(2.1) -0„,fc(t) 



g{t) h{ln^k, t) ■ Ln,k , In.k <t< nin^k i 

g{t) h{t, rn,k) ■ Rn,k , rnn,k < t < rn,k , 



and the basis element -00,0 is given on [0, 1] by 

^o,o(i) = 9{t)h{lofi,t) ■ Lofi. 
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The definition implies that the ipn,k are continuous functions in the space 
of piecewise derivable functions with piecewise continuous derivative which 
takes value zero at zero. We denote such a space Co([0, 

Before studying the property of the functions ■j/'n,fc) it is worth remember- 
ing that their definitions include the choice of a square root cr^ ^ of 5]„ fc. 
Properly speaking, there is thus a class of bases V'n,fc a-nd all the points we 
develop in the sequel are valid for this class. However, for the sake of sim- 
plicity, we consider from now on that the basis under scrutiny results from 
choosing the unique square root cr„ that is lower triangular with positive 
diagonal entries (Cholesky decomposition). 

2.1.1. Underlying System of Orthonormal Functions. We first introduce 
a family of functions cf)n,k and show that it constitutes an orthogonal basis 
on a certain Hilbert space. The choice of this basis can seem arbitrary at 
first sight, but the definition of these function will appear natural for its 
relationship with the functions ipn,k and $n,fc that is made explicit in the 
sequel, and the mathematical rigor of the argument leads us to choose this 
apparently artificial introduction. 

Definition 2. For every (n, k) in I with n 7^ 0, we define a continuous 
function : [0, 1] W^""^ which is zero outside its support Sn k and has 
the expressions: 



(2.2) Cj)n,k{t) 



f{'t)'^-Ln,k, ^n,k<t< 1T^n,k , 

f{tV-Rn,k, rnn^k<t<rn,k ■ 



The basis element 0o,o is defined on [0, 1] by 
(2.3) cf,o^o{t) = f{tf -Lo^o- 

Remark that the definitions of make apparent that fact that these two 
families of functions are linked for all (n, k) in I through the simple relation 



(2.4) -0' = a • iPn,k + \/f • 0, 



'n,k 



Moreover, this collection of functions (j)n,k constitutes an orthogonal basis 
of functions, in the following sense: 

Proposition 5. Let L'^^ he the closure of 

{w : [0, 1] ^ I 3 e L2 ([0, 1], E"^) , It = • , 
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equipped with the natural norm o/ L^([0, IJjM*") . It is a Hilhert space, and 
moreover for all < j < d, the family of functions cj {4>n,k) defined as the 
columns of (f)n,k, namely 

Cj {4>n,k) = [(0n.,fc)ij]o<i<m : 

forms a complete orthonormal basis of L^. 

Proof. The space Lj is clearly a Hilbert space as a closed subspace of 
the larger Hilbert space L^([0, 1],M™) equipped with the standard scalar 
product: 

y u,v e L^{[0,1],M.'^) , {u,v)=[ u{tf-v{t)dt. 

Jo 

We now proceed to demonstrate that the columns of (f)n,k form an orthonor- 
mal family which generates a dense subspace of L^. To this end, we define 
M([0, 1],M'"^'^) the space of functions 

{A : [0, 1] ^ M™x'^ I V j : < j < d,t ^ [A. W]o<^<™ ^ L^O, 1],R-)} , 

that is, the space of functions which take values in the set of m x d-matrices 
whose columns are in L^([0, This definition allows us to define the 
bilinear function V : M([0, 1],^"*^^) x M([0, 1],M'"^°') R"^""^ as 

r{A,B)= [ A{tf-B{t)dt satisfying P{B, A) = V{A, Bf , 
Jo 

and we observe that the columns of 4>n,k form an orthonormal system if and 
only if 

y {{p,q),{n,k)) elxl, r{(Pn,k,(pp,q)= [ Ct)n,k{tf ■ (tip,q{t) dt = 6;;^ Id , 

Jo 

where 6p'q is the Kronecker delta function, whose value is 1 if n = p and 
k = q, and otherwise. 

First of all, since the functions cf)n,k are zero outside the interval Sn,k, the 
matrix V{(t)n,kj 4'p,q) are non-zero only if Sn,k H Sp^g / 0. In such cases, 
assuming that n ^ p and for example that n < p, we necessarily have Sn,k 
strictly included in Sp^g-. more precisely, 5^^^ is either included in the left- 
child support Sp+i^2q or in the right-child support of Sp^g. In both 
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cases, writing the matrix V{4>n,k{t)^4>p,q) shows that it is expressed as a 
matrix product whose factors include V{4>n,k: f'^)- We then show that: 

Jo 

= Ll, ■ / fiu) ■ f{u) du - Rl, ■ / fiu) ■ f{u) du , 

= L^,k ■ Hln,k, mn,k) - Rn,k ' H^T^n,k, rn,k) 

T -\i \T T -1/ \T 
= ^n,k9 ("l„,fc) -0-n,k9 ("ln,fc) , 

which entails that V{(t)n,k, f'^) = if n < p. If n > p, we use the fact 

that V{4>n,k-. 4>p,q) = 'P{4>p,q, 4>n,k)'^ , and we conclude that V{4>n,k-. 4>p,q) = 
from the preceding case. Fot n = p, we directly compute for n > the only 
non-zero term 

'P{(l)n,k, (f>n,k) = L^^k ■ / /M • /^(^^) du ■ Ln,k 

+ Rlk- / f{u)- f{u)du-Rr,,k, 

= a'^^^g^^{mn,kf [h{ln,k-,'mn,k)) ^ g^^{mn,k) (^n,k 

+ ^n,k9~^i.'^n,kf {Hmn,k,rn,k)y^ 9~^imn,k)o-n,k ■ 

Using the passage relationship between the symmetric functions h and ^m,i k 
given in equation (1.5), we can then write 

T^{4>n,k^4>n,k) = (^n,k {^m„^ki^n,k, 'mn,k)) ^<^n,k 

+^n,k {Knr,,k i'^n,k,rn,k)) ^ <^n,k ■ 

Proposition 4 implies that hm„^y, {ln,k,'mn,k)~^+hm„^k i'^n,k, rn,k)~^ = = 
('^n,fc)^'^n,fc which directly implies that V{cf)n,k, (f>n,k) = ^d- n = 0, a 
computation of the exact same flavor yields that P(0o,O) 0o,o) = Id- Hence, 
we have proved that the collection of columns of (f>n,k forms an orthonor- 
mal family of functions in Lj (the definition of (f>n,k clearly states that its 
columns can be written in the form of elements of L^f)- 

The proof now amounts showing the density of the family of functions we 
consider. Before showing this density property, we introduce for all (n, k) in 
I the functions Pn,k '■ [0, 1] — M'^^'^ with support on ^ defined by: 

T3 J Ln^k if ln,k < t < IJln^k , n ^ D r 

PnMi) = i R ;f ^ < f^r- H / and Pofi{t) = Lq^ 

y - Rn,k It rnn,k St < rn^k 
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Showing that the family of columns of 4>n,k is dense in Lj is equivalent to 
show that the column vectors of the matrices Pn,k seen as a function of 
i, are dense in ([0, 1], M*^) . It is enough to show that the span of such 
functions contains the family of piecewise continuous M'^-valued functions 
that are constant on S^^fc, (n, k) in I (the density of the endpoints of the 
partition Uj\i^fqD]\j entails that the latter family generates L'^{[0, 
In fact, we show that the span of functions 

Vn = span |t i— Cj{Pn,k){t) < j < d , {n,k) & 

is exactly equal to the space of piecewise continuous functions from [0, 1] 
to that are constant on the supports S'^r+i^fc, for any (A^ + 1, A;) in X. The 
fact that Vn is included in Kn is clear from the fact that the matrix-valued 
functions PN,k are defined constant on the support SN+i,k, for {N,k) in I. 

We prove that Kn is included in Vn by induction on < 0. The prop- 
erty is clearly true at rank = since Pq^ is then equal to the constant 
invertible matrix Lq q. Assuming the proposition true at rank A^ — 1 for a 
given A^ > 0, let us consider a piecewise continuous function c : [0, 1] — )• 
in Kn-1- Remark that for every {N,k) in I, the function c can only take 
two values on SN,k and can have discontinuity jump in mN,k- let us denote 
these jumps as 

dN,k = c{mjf f,) - c{m~ i^) . 

Now, remark that for every (A^, k) in X, the matrix-valued functions i-V.fc 
takes only two matrix values on SN,k^ namely LN,k and —RN,k- From Propo- 
sition 4, we know that LN,k + f^N,k = ^N,k is invertible. This fact di- 
rectly entails that there exists vectors flAr^fc, for any {N,k) in I, such that 
dN,k = {LN,k + RN,k){—o-N,k)- We then necessarily have that the function 
c' = c + Pn^k • 0'n,k is picccwise constant on the supports SN,k, i^, k) in X. 
By recurrence hypothesis, c' belongs to Viv-i, so that c belongs to Vn, and 
we have proved that Kn C Vn- 

Therefore, the space generated by the column vectors Pn^k is dense in L'^[0, 1], 
which completes the proof that the functions t i— )• [(<^n,fc(i))jj]o<j<m foi^™ a 
complete orthonormal family of L2[0, 1]. □ 

The fact that the column functions of (t)n,k form a complete orthonormal 
system of directly entails the following decomposition of the identity on 
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Corollary 2. If 6 is the real delta Dirac function, we have 

(2.5) Yl <l>nAt) ■ 4>lkis) = Sit - s)IdLp 
(n,fc)eX 

Proof. Indeed it easy to verify that for all t> in Lj, we have for all A?" > 

j Y i^riMt) ■ <t}l,kis)) Vis)ds = Y 4>n,kit) -V ict)n,k.v) , 

^ (n,fc)6ljv (n,fc)eljv 

d-1 

= Y X]'^p('^"'*^Hcp(0n,fc),1') , 

(n,fc)eXiv P=0 

where (cp(0„^fc), i)) denotes the inner product in between v and the 
p-column of 'ipn,k- Therefore, by the Parseval identity, we have in the 
sense 

/ Y i^^^kit) ■ 4>l,k{s)) vis) ds = vit) . 
■^^ {n,k)el 

□ 

From now on, abusing language, we will say that the family of M"^^*^- 
valued functions cf>n,k is an orthonormal family of functions to refer to the 
fact that the columns of such matrices form orthonormal set of L^. We 
now make explicit the relationship between this orthonormal basis and our 
functions iii^n,k) derived in our analysis of multi-dimensional Gauss-Markov 
processes. 

2.1.2. Generalized Dual Operators. 

The integral operator fC . The basis 4>n,k is of great interest in this ar- 
ticle for its relationship to the functions ■0n,fc that naturally arise in the 
decomposition of Gauss-Markov processes. Indeed, the collection rl)n,k can 
be generated from the orthonormal basis 0n,fc through the action of the 
integral operator K, defined on L2([0, 1],M™) into L2([0, l],W^) by: 

(2.6) u^K:[u] = |t^g(i)-^l[o,t](s)/(s)M(s)ds| 

where U D [0, 1] is an open set and where, for any set E C U, !£;(•) denotes 
the indicator function of E. Indeed, realizing that /C acts on M([0, 1],]R™^'^) 
into M([0, 1],M'='^'^) through 

VAg Af([0,l],]R'"X'^), }C[A]= [/C[co(A)],...,/C[c,_i(A)] 
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where Cj{A) denote the j-th M'^-vahied cohimn function of A, we easily see 
that for all (n, /c) in X, < t < 1: 

(2.7) = 9{t) • r f{s) • 0„.fc(s) ds = JC[cl)n,km ■ 

Jo 

It is worth noticing that the introduction of the operator /C can be considered 
natural since it characterizes the centered Gauss-Markov process X through 
formally writing X = JC[W] . 

In order to exhibit a dual family of functions to the basis tpn,k> we further 
investigate the property of the integral operator /C. In particular, we study 
the existence of an inverse operator D, whose action on the orthonormal 
basis (pn.k will conveniently provide us with a dual basis to Such an 

operator does not always exist, nevertheless, under special assumptions, it 
can be straightforwardly expressed as a generalized differential operator. 

The differential operator D . Here, we make the assumptions that m = d, 
that for all t, f{t) is invertible in M.'^^'^ and that / and f ^^ have continuous 
derivatives, which especially implies that Lj = L^(M'^). In this setting, we 
define the space Do ([/, M^) of functions in ([/, M^) that are zero at zero, 
and denote by D'q (U, M*^) its dual in the space of distributions (or generalized 
functions). Under the assumptions just made, the operator JC : Doil/jW^^ i— )• 
Do{U,R'^) admits the differential operator V : Do{U,R'^) H> DolU,^^) 
defined by 

u G Do{U,W'') ^ V[u] = |t ^ f~\t)j^(^g-\t)uit)) I . 

as its inverse, that is, when restricted to Dq ([/, M'^) , we have 'DoJC = JCoT) = 
Id on Dq{U,M.'^). The dual operators of JC and V are expressed, for any u 
in Do{U,M.'^), as 

= S^t^-{9-\t)ff^{{r\t)fu{t))y 

JC*[u] = !^t^-f{tf J^l[o^t]{s)g^{s)u{s)dsy 

They satisfy (from the properties of JC and V) V* o JC* = JC* o V* = Id 
on Dq{U,W^). By dual pairing, we extend the definition of the operators 
/C, T) as well as their dual operators, to the space of generalized function 
Dq{U,W^). In details, for any distribution T in D'q{U,W^) and test function 
u in Do{U,W^), define JC and JC* by 

{V[T],u) = {T,V*[u]) and {JC[T],u) = {T,JC*[u]) , 
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and reciprocally for the dual operators T>* and IC* . 



Candidate Dual Basis . We are now in a position to use the orthonormality 
of the 4>n,k to infer a dual family to the basis of elements il'n^k- For any 
function u in {U, W^') , the generalized function IC [u] belongs to Co(U, W^) , 
the space of continuous function which are zero at zero. We equip this space 
with the uniform norm and denote its topological dual Ro[U,W^) , the set of 
d-dimensional Radon measures with Ro{U,R'^) C D'q{U,R'^). Consequently, 
operating in the Gelfand triple 

(2.8) Co {U, M'^) C [U, R'^) C Rq {U, R'^) , 

we can write, for any function u, v in L^([/, M'^) C Ro[U,R'^) 

iu,v) = ({VolC)[u],v)=ilC[u],V*[v]) 



The first equality stems from the fact that, when /C and T> are seen as 
generalized functions, they are still inverse of each other, so that in particular 
"Do/C = Id on L^(jJ, M*^) . The dual pairing associated with the Gelfand triple 
(2.8) entails the second equality where T>* is the generalized operator defined 
on D'o{U,R'^) and where V*[v] is in Ro{U,R'^). 

As a consequence, defining the functions Sn,k in R(s{U,R'^^'^) , the d x d- 
dimensional space of Radon measures, by 



'D*i(l}n,k) = [P*[ci(0„,fc)],...,^?*M(0n,fc)]]] 



provides us with a family of c? x d-generalized functions which are dual to 
the family ipn,k in the sense that, for all ((n, k), {p, q)^ in X x X, we have 

'P{Sn,k,'4'p,q) = Sp]q Id , 

where the definition of V has been extended through dual pairing: given any 
A in Ro{U,R"''"^) and any B in Co{U,R"''"^) , we have 



V{A,B)= (q(A),c,(B)) 



0<i,j<d 



with (cj(A), Cj(S)) denoting the dual pairing between the i-th column 
of A taking value in Roi^l/jR"^^ and the j-th. column of B taking value 
in Cq[U,R'^) . Under the favorable hypothesis of this section, the d x d- 
generalized functions Sn,k can actually be easily computed, since considering 
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the definition of cf)n^k sliows that the functions {f~^)'^ • (pn,k have support 
Sn,k and are constant on 5„_|_i^2fc and S'„_|_i^2fc+i in K"'^'^. Only the discon- 
tinuous jumps in In^k, iT^n,k and rn,k intervene, leading to express for {n,k) 
in X, n 7^ 

Sn,k{t) = {a{t)~^f ■{^n,k - 'mn,k) " (^n,fc - ln,k) + Rn,k S{t " rn,k))) 

and dofl{t) = {g{t)~^)'^ ■ Lq^, where 6{-) denotes the standard delta Dirac 
function (centered in 0). These functions can be extended to the general 
setting of the article since its expressions do not involve the assumptions 
made on the invertibility and smoothness of f{t). We now show that these 
functions, when defined in the general setting still provide a dual basis of 
the functions tpn,k- 

2.1.3. Dual Basis of Generalized Functions. The expression of the basis 
Sn^k that has been found under favorable assumptions makes no explicit 
reference to these assumptions. It suggest to define a functions Sn,k formally 
as linear combination of Dirac functions acting by duality on Co(C/, M*^^*^): 

Definition 3. For (n, k) in I, the family of generalized functions Sn,k 
in Rq[U,'R''-^^) is given n / by 

Sn,ki't) = {aity^Y ■{Mn,k S{t - mn,k) " {Ln,k <5(t " ln,k) + Rn,k S{t - rn,k))) , , 

and (5o,o(i) = {g{t)~^)'^ ' Lq^, where 6 is the standard Dirac distribution. 

Notice that the basis Sn,k is defined for the open set U. For the sake of 
consistency, we extend the definition of the families ipn,k and cj)n^k on U by 
setting them to zero on ?7\ [0, 1], except for tpo^ which is continued for t > 1 
by a continuous function c that is compactly supported in [1, a) for a given 
a in U, a > 1 and satisfy c(l) = ipQfi{l). 
We can now formulate: 

Proposition 6. Given the dual pairing in Co{U) C L'^{U) C R{U) 
where U is a bounded open set o/ M containing [0, 1], the family of contin- 
uous functions 'tpn,k in Cq{U) admits for dual family in R{U), the set of 
distributions 8n,k- 



Proof. We have to demonstrate that, for all ((n, k), {p, q)) in X x X, 
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Suppose first, n,p > 0. If p < n, 'P{6n,k-,'4'p,q) can only be non-zero if tlie 
support Sp^q is strictly included in S^^k- We then have 

V{Sp^q,ll^n,k) = Mpqg-^{mp^g)ll)n,k{'mp,q) 

- {Lp,q9~'^ilp,q)'4^n,k{lp,q) + Rp,q9~^{rp,q)'lpn,k{rp,q)) ■ 

Assume Sp^g is to the left of vrin^k^ that is, Sp^q is a left-child of Sn^k in the 
nested binary tree of supports and write 

V{Sp^q,1pn,k) = (^Mp qh{ln,k,rnp^q) - Lp qh{ln,k,lp,q)) - Rp^qh{ln,k, Tp^q))^ Ln,k ■ 

Using the fact that Mp^q = Lp^q + Rp^q and that the function h{x, y), as any 
integral between x and y, satisfies the chain rule h{x, y) = h{x, z) -\- h{z, y) 
for all {x,y,z), we obtain: 

'P{^p,q^ i^n,k) = ( - Lp q {h{ln,k, rUp^q) - h{ln,k, lp,q)) 

+Rp^q {h{^n,k,'mp,q) — h{^n,k,'''p^q))^ Ln^k 
= — Lp^g h{lp^q, mp^q) + R^^q h{rp^q, mp^q)^ Ln^k 

= ( - f^p,qi9~^{^P,q))'^iH^P,q^^T^P,q)~^)'^ ' Hlp,q,mp,q) 

+'^p,qi9~'^imp,q)fiHmp,q,rp^q)~^f ■ h{mp^q, Vp^q)^ ■ Ln,k 

= 

The same result is true if Sp^q is a right-child of Sn,k in the nested binary 
tree of supports. If p = n, necessarily the only non-zero term is for q = p, 
i.e. 

V{Sp^q,il}n,k) = M^i.g~'^{mn,k)ip{rnn,k) 

= ^I,k^''i^n,k,'mn,k) Ln^k 

= a'q 9{mn,k) Hln,k, "T-n.fc) Hln,k, "T-n.fc)""^ 9~^imn,k) O^p^q 
= Id- 

If p > n, V[Sn,k,fpp,q) can only be non-zero if the support Sn,k is included 
in Sp^q, but then tl'n,k is zero in Ip^q, nip^q, Vp^q so that 'P{6n^k-,'^p,q) = 0- 
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and p > 0, we directly have 

- {Lp,q9^'^{lp,q)lp0,0{lp,q) + Rp,g {rp,q)'4'0,o{fp,q)) , 

( - Lp^q H^P,q^ ^P,q) + ^l,q H'mp,g, rp^g)^ Lq^q , 
( - (^p,q9~'^{mp^qf + (^p,q9~^{mp^gf)^Ln,k , 

0. 

Finally, if p = 0, given the simple form of (5o.o with a single Dirac function 
centered in ro,o, we clearly have 'P{Sofi,ipn,k) = 0, and if n > 

= f^o,o{9~^{ro,o))^ Lofi, 

and using the fact that (by definition of (Tq q) we have ctq q ■ CTq'q — Cj-qq, 
this last expression is equal to: 

'P(^0,0,''/'0,o) = I^Ofi {^Qfl) ^ ■ ('''O.o) CTO.O = Id, 
which completes the proof. □ 

This proposition directly implies the main result of the section: 

Theorem 7. The collection of functions {ipn.k {n^k) G X) constitute 
a Schauder basis of functions on Co{U,M.'^). 

This theorem provides us with a complementary view of stochastic pro- 
cesses: in addition to the standard sample paths view, this structure allows 
to see Gauss-Markov processes as coefficients on the computed basis. This 
duality is developed in the sequel. 

2.2. The Sample Paths Space. 

2.2.1. The Construction Application. The Schauder basis of functions 
with compact supports constructed allows to define functions by considering 



Otherwise, if n = 
'P{Sp^g,ipo,o) = 
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the coefficients on this basis, which constitute sequences of real numbers in 
the space: 

= = { W^ll ; V (n, A;) G X, e„,fc G M'^} = 

We equip ^Cl with the uniform norm ||^||oo = s^V{n,k)£l\^n,k\^ where we 
write \^n,k\ = supo<i<d \{^n,k)i\- We denote by B (gil) the Borehan sets of the 
topology induced by the uniform norm and we recall that C(^fl), the cylinder 
sets of ^ri, form a generative family of Borelian sets. Remark that not any 
sequence of coefficients provide a continuous function, and one needs to 
assume a certain decrease in the coefficients to get convergence. A sufficient 
condition to obtain convergent sequences is to consider coefficients in the 
space: 

^!^' = 1^ G I 3(5 G (0,1), 3N G N, V(n, fc) GX\Xiv, \in,k\ < 2^^} 

This set is clearly a Borelian set of ^Q, since it can be written as a countable 
intersection and union of cylinder, namely, by denoting J the set of finite 
subset of N and 6p = 1 — 1/p, p > 1, 

= u u n ^ I o<s- 

P>1J€J neN\J 

It is also easy to verify that it forms a vectorial subspace of ^0. 

After these definitions, we are in position to introduce the following useful 
function: 

Definition 4. We denote by the partial construction application: 



N 



^Co([o,i],] 

' ^ I^(n,fc)eXiv '^n,k{t) ■ in,, 



where the Co([0, 1], M j is the d-dimensional Wiener space, which is complete 
under the uniform norm ||a;||oo = supo<t<i 

This sequence of partial construction applications is shown to converge 
to the construction application in the following: 

Proposition 8. For every i in ^^l' , ^^(^) converges uniformly toward 
a continuous function in Co([0, 1],^*^). We will denote this function ^(^), 
defined as: 

^ Ln' ^Co([o,i],R'^) 
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and this application will be referred to as the construction application. 



This proposition is proved in appendix D. The image of this function 
constitutes a subset of the Wiener space continuous functions Co([0, 1], M*^). 
Let us now define the vectorial subspace x^' = "^i^^') of C'o([0, lliK'^) so 
that * appears as a bijection. 

It is important to reahze that, in the multidimensional case, the space ^Q' 
depends on T and a in a non-trivial way. For instance, assuming a = 0, the 
space j-O' depends obviously crucially on the rank of T. To fix idea, for a 
given constant y^r(t) = [0, . . . 1]"^ in M*^^^, we expect the space ^Jl' to only 



include sample paths of Co([0, 1],M'*) for which the n—1 first components 
are constant. Obviously, a process with such sample paths is degenerate in 
the sense that its covariance matrix is not invertible. 

Yet, if we additionally relax the hypothesis that o: 7^ 0, the space ^.O' can 
be dramatically altered: if we take 



exit) 



1 



1 




the space ^fi' will represent the sample space of the d— 1-integrated Wiener 
process, a non-degenerate d-dimensional process we fully develop in the ex- 
ample section. 

However, the situation is much simpler in the one-dimensional case: be- 
cause the uniform convergence of the sample paths is preserved as long as a 
is continuous and T is non-zero through (D.2), the definition does not 
depend on a or F. Moreover, in this case, the space x^' is large enough to 
contain reasonably regular functions as proved in appendix D, Proposition 
23. 

In the case of the d— 1-integrated Wiener process, the space ^il.' clearly 
contains the functions {/ = {fd-i, • • • , /o) \fo^H,f-= ,0 <i < d}. 

This remark does not holds that the space ^fl' does not depend on a 
as long as a is continuous, because the uniform convergence of the sample 
paths is preserved through the change of basis of expansion ipn k through 
(D.2). 

We equip the space x^' with the topology induced by the uniform norm 
on Co([0, 1],M'^). As usual, we denote B{x^') the corresponding Borelian 
sets. We prove in Appendix D that: 
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Proposition 9. The function * : {^^l' , B {^^l')) {x^' ,B{xfl.')) is a 
bounded continuous bijection. 

We therefore conclude that we dispose of a continuous bijection mapping 
the coefficients onto the sample paths, ^. We now turn to study its inverse, 
the coefficient application, mapping sample paths on coefficients over the 
Schauder basis. 

2.2.2. The Coefficient Application. In this section, we introduce and 
study the properties of the following function: 

Definition 5. We call coefficient application and denote by H the func- 
tion defined by: 



Should a function x admits a uniformly convergent decomposition in terms 
on the basis of elements i/'n,*:) the function A gives its coefficients in such a 
representation. More precisely, we have: 

Theorem 10. The function A : {x^',B{x^')) {(.Q' ,B {^n')) is a 
measurable linear bijection whose inverse is ^ = A^^. 

The proof of this theorem is provided in Appendix D 

3. Representation of Gauss-Markov Processes. 

3.1. Inductive Construction of Gauss-Markov Processes. Up to this point, 
we have rigorously defined the dual spaces of sample paths x^' and coeffi- 
cients ^Q' . Through the use of the Schauder basis ■j/'n,fc and its dual family of 
generalized functions Sn,k, we have defined inverse measurable bijections ^ 
and A transforming one space into the other. In doing so, we have unraveled 
the fundamental role played by the underlying orthonormal basis 0n,fc- We 
now turn to use this framework to formulate a path-wise construction of 
the Gauss-Markov processes in the exact same flavor as the Levy-Cesielski 
construction of the Wiener process. 

3.1.1. Finite- Dimensional Approximations. Considering the infinite di- 
mensional subspace x^' of Co ([0, 1], M'^) , let us introduce the equivalence 



(2.9) 
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relation ~7v as 

xr^NV-^^ yt€DN, x{t) = y{t). 

We can use the functions ^ to carry the structure of ~jv on the infinite- 
dimensional space of coefficients ^0': 

which clearly entails that a; ~7v 2/ if and only if A (a;) ~jv A(y). We denote 
the sets of equivalence classes of x^' / ^N= x^N and ^J^'/ ^n= ^^n, which 
are isomorphic x^N = (M'^)'^ = ^Qn- For every > 0, we define the finite- 
dimensional operators = x'i-N o ^Pn and A^r = ^in ° ^ ° xPn, with 
the help of the canonical projections ^pN '■ — ^^^a^, xPn '■ x^' — x^N 
and the inclusion map ^i^r : ^f^Tv — ^ ^^^'j x^N '■ x^N x^' ■ 

The results of the preceding sections straightforwardly extend on the 
equivalence classes, and in particular we see that the function ^ jy : — ^ 
x^N and Atv : x^N are linear finite-dimensional bijections satisfy- 

ing *Ar = We write e = {ep,g}(p_g)gj (resp. / = {/p,g}(p,g)6x) the 

canonical basis of (resp. x^n) when listed in the recursive dyadic order. 
In these bases, the matrices and Ajy are lower block-triangular. Indeed, 
denoting *Ar in the natural basis e = {ep,g}(p g)^^: and / = {fp,q}(p^q)ei by 

where is a d x d matrix, the structure of the nested-support Sn^k entails 
the block-triangular structure (where only possibly non-zero coefficients are 
written): 

















^0 


u 






u 










^0 












,2,0 
^2,0 






^0 


i 
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^2,1 






^0 
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^0 
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^2,0 
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Similarly, for the matrix representation of A^v in the natural basis e^^k and 

fi,j 



n,k 



proves to have the following triangular form: 



' g-\to,ofMo^o 






















—g'^itofi) R2,o 


g-\h,ofM2,o 


g~Ht2,ifM2,i 















The duality property 6 simply reads for all < n < and < /c < 2" ^, 
< p < iV and < p < 2^^^ 



Z-^ ij n,k 



i,k-^d ■ 



that is, Aat • ^'at = Id^^j^. But because, we are now in a finite-dimensional 
setting, we also have 'J' at • A^r = Id^ 



/ . ^P,q ^k,l ■ 



(p,'?)ex 



JV 



Realizing that d represents the class of functions a; in ^^f^' whose value 

are zero on every dyadic points of Dn except for x{l2'^) = 1^, \ A?'? > 

clearly appear as the coefficients of the decomposition of such functions in 
the bases ij^p^q for {p, q) in Z^- 

Denoting H = {'an^k}{n,k)<^i-> ^ set of independent Gaussian variables of 
law A/'(0, Ifi) on (0, P), and for all > 0, we form the finite dimensional 



Gauss-Markov vector 



X/^- as 



X 



N 



J2 

(n,A;)gIjv 



which, from Corollary 1, has the same law as [Xt]^^j)^, the finite-dimensional 
random vector obtained from sampling X on D]\f (modulo a permutation 
on the indices). We then prove the following lemma that sheds light on the 
meaning of the construction: 
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Lemma 2. The Cholesky decomposition of the finite- dimensional covari- 
ance block matrix Yl^ is given by Yl^ = ^ ■ ^n'^ . 

Proof. For every < t, s < 1, we compute the covariance of the finite- 
dimensional process as 

N 

CNit, S)=E [Xf • [X^f] = ^ • i-^nA^))^ > 

n=0 0<fc<2"-l 

From there, we write the finite-dimensional covariance block matrix Sjy in 
the recursively ordered basis fij for 0<i<A^, 0<j< 2^^^, as 

N 

n=0 0<fc<2"-l 

We already established that the matrix was triangular with positive 
diagonal coefficient, which entails that the preceding equality provides us 
with the Cholesky decomposition of S. □ 

In the finite-dimensional case, the inverse covariance or potential matrix 
is a well-defined quantity and we straightforwardly have the following corol- 
lary: 

Corollary 3. The Cholesky decomposition of the finite- dimensional 
inverse covariance matrix 'SJj^ is given by = An"^ ■ An- 

Proof. The result stems for the equalities: = (*Ar-*Ar^)~^ = 

■ = A^^ • An. □ 

3.1.2. The Levy-Cesielski Expansion. We now show that asymptotically, 
the basis il>n,k allows us to faithfully build the Gauss-Markov process from 
which we have derived its expression. In this perspective we consider H = 
{'Bin,k}{n,k)€ii ^ sct of independent Gaussian variables of law AA(0,/d) on 
P), and for all > 0, we form the finite dimensional continuous 
Gaussian process , defined for < t < 1 by 

(n,fe)GXjv 

which is, from the result of Theorem 3, has the same law = E [X^IJ^^]. 
We prove the following lemma: 
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Lemma 3. The sequence of processes almost surely converges to- 
wards a continuous Gaussian process denoted . 

Proof. For all fixed > and for any u in Q, we know that t i— >• 
Xj^ (uj) is continuous. Moreover, we have establish, that for every ^ in ^Q', 
X^(^) converges uniformly in t toward a continuous limit denoted X^{^). 
Therefore, in order to prove that limAr_s>oo X^ defines almost surely a process 
X with continuous paths, it is sufficient to show that P^(^Q') = 1, where 
= P=-i is the H-induced measure on ^O, which stems from a classical 
Borel-Cantelli argument. For ^ a random variable of normal law AA(0, 1), 
and a > 0, we have 

^ I „„2/9 , . iz I u „„2/9 . lie ' 



P(|^|>„)= /!/ e"^'l^du<J- -e-^y^du 



Ja \ Ja a V vr a 

Then, for any 6 > 

Pg( max > 2f) < d2"P(|e| > d2'i) = .^2^^-^/^^''exp f-2"^-i 

o<fc<2"-i ' V vr V 



Since the series 

°° At" 



(3.1) 5^ ^^2(1-5/2)- exp (-2- 

71=0 

is convergent, the Borel-Cantelli argument implies that Pg(jr2') = 1. Eventu- 
ally, the continuous almost-sure limit process Xf^ is Gaussian as a countable 
sum of Gaussian processes. □ 

Now that these preliminary remarks have been made, we can evaluate, 
for any t and s in [0, 1], the covariance of X as the limit of the covariance 
of X^. 

Lemma 4. For any < t,s < 1, the covariance of X°° = {X^ = 
*t oS;0<t<l} is 

(3.2) C{t, s)=E [xr ■ {Xrf] = g{t) h{t A s) gisf . 

Proof. As H„ ^ are independent Gaussian random variables of normal 
law M{0, Id), we see that the covariance of is given by 

c^(t, s) = E [xf • [x^f] = Mt) ■ iMs)f ■ 
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To compute the limit of the right-hand side, we recah that the element of 
the basis i/'n,fc ^-iid the functions <^n,fc are linked by the following relation 

-^n.fcW = K,[4>n^k] = git) / l[0,t](s)/(s) 0n,fc(s) ds 

J u 



from which we deduce 



\(n,fc)eXjv ^ 



k{u) du 



u 



'^[0,s]{v)f{v)<l)n,k{'")dv] ]g{s) ■ 



Defining the auxiliary M"'^ '^-valued function 



l^n,k{t) = / l[o^t]{u)f{u)4>n,k{u)du, 

J JJ 

we observe that (i, j)-coefficient function reads 



where 1[q^^] is the real function that is one if < u < t and zero otherwise. 
As we can write 



l[o,t](^i) 



we see that the function fi^t = l[o,t] Ci{f'^) belongs to Lj, so that we can 
write {i^n,k)i,j{t) a-s a scalar product in the Hilbert space L^: 

{l^n,k)i,j{t) = / f^tiu) ■ Cj{(f)n,k{u)) du = {fi,t, Cj[4>n,k)) ■ 
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We then specify the (z, j)-coefficient of g^^{t) {t, s) [g~^{s))'^ writmg 

{n,k)eXN {n,k)eXN P=0 

and, remembering that the family of functions Cj [4>n,k) forms a complete 
orthonormal system of Lp we can use the Parseval identity, which reads 



J2 ['^it).K{sf)^^ = [f,,t,U 

(n,k)eX 



^lo,t]{u) Ci{f {u)) ■ lio,s]{u)cj{f {u))du, 

tAs 



/tAs 



Thanks to this relation, we can conclude the evaluation of the covariance 
since 

^lirn^ C^(t, s) = g{t) (/ • f) (n) dv^ g{sf = g{t)h{t A s) g{sf , 

□ 

We stress the fact that the relation 

Cit,s)= V'n,fc(i) • (^n,fc(s)f = o 

(n,fc)eX 

provides us with a continuous version of the Cholesky decomposition of the 
covariance kernel C. Indeed, if we chose <t„ ^ as the Cholesky square root of 
Sn,fc5 we remark that the operators ^ are triangular in the following sense: 
consider the chain of nested vectorial spaces {-Fn,fc}(„ ^jgj 

Fo,o C Fi,o C (F2,o C F2,i) . . . C (F„,o C . . . C F„,2"-i) . . . C 

with Fn^k = span {fij | < « < n, < j < A;}, then for every (n, k) in I, the 
operator ^ transforms the chain {I^n,k} k)&x ^^^^ chain 

"^O.O C Slfi C {£2,0 C £2,1) • • • C {£n,0 C . . . C £n,2"~l) • • • C x^' 

with £n^k = span {"^ij \ 0<i<'n,0<j<k}. 

The fact that this covariance is equal to the covariance of the process X 
solution of equation (1.1) implies that we have the following fundamental 
result: 
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Theorem 11. The process X°° is equal in law to the initial Gauss- 
Markov process X used to construct the basis of functions. 

Remark 2. Our multi-resolution representation of Gauss-Markov pro- 
cesses appears to be the direct consequence of the fact that, because of 
the Markov property, the Cholesky decomposition of the finite-dimensional 
covariance admit a simple inductive continuous limit. More generally, trian- 
gularization of kernel operators have been studied in depth [8, 9, 24, 28] and 
it would be interesting to investigate if these results make possible a sim- 
ilar multi-resolution approach for non-Markov Gaussian processes. In this 
regard, we naturally expect to lose the compactness of the supports of a 
putative basis. 

3.2. Optimality Criterion of the Decomposition. In the following, we 
draw from the theory interpolating spline to further characterize the nature 
of our proposed basis for the construction of Gauss-Markov processes. We 
show, following [17, 30], that the finite-dimensional sample paths of our con- 
struction induce a nested sequence Sjy of reproducing Hilbert kernel space 
(RKHS). In turn, the finite-dimensional process naturally appears as 
the orthogonal projection of the infinite-dimensional process X onto i^Ar.We 
then show that such a RKHS structure allows us to define a unicity crite- 
rion for the finite-dimensional sample path as the only functions of £ that 
minimize a functional, called Dirichlet energy, under constraint of interpo- 
lation on D]\f (equivalent to conditioning on the times D^), thus extending 
well-known results to multidimensional kernel [46]. In this respect, we point 
out that the close relation between Markov processes and Dirichlet forms 
is the subject of a vast literature, largely beyond the scope of the present 
paper (see e.g. [22]). 

3.2.1. Sample Paths Space as a Reproducing Hilbert Kernel Space. In 
order to define the finite-dimensional sample paths as a nested sequence of 
RKHS, let us first define the infinite-dimensional operator 

Since we know that the column functions of (f)n,k form a complete orthonor- 
mal system of Lp the operator $ is an isometry and its inverse satisfies 
= which reads for all v in Lj 

[*"'M] = 4>lk{t) ■ v{t) dt = v{ci,n,k,v) . 
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Equipped with this infinite-dimensional isometry, we then consider the hnear 
operator £ = $ o A siutably defined on the set 

£ = {ueCo{U,R'^)\C[u] G L}] = {ueCo{U,R'^)\A[u] G l^{^n)} . 

with ||^||2^ = X]„ fcgx l^n.fcb^; the P norm of gil. The set £ form an infinite- 
dimensional vectorial space that is naturally equipped with the inner product 

y{u,v)e£^, {u,v)= [ C[u]{tf ■ C[v]{t)dt= {C[u],£[v]) , 

Ju 

Moreover since ■u(O) = v{0) = 0, such an inner product is definite positive 
and consequently, £ forms an Hilbert space. 

Remark 3. Two straightforward remarks are worth making. First, the 
space £ is strictly included in the infinite-dimensional sample paths space 
x^' . Second notice that, in the favorable case m = d, if / is everywhere 
invertible with continuously differentiable inverse, we have C = V = K,~^. 
More relevantly, the operator C can actually considered a first-order differ- 
ential operator from £ to L ^ as a general left-inverse of the integral operator 
K,. Indeed, realizing that on Lp K, can be expressed as K, = ^'o$~^, we 
clearly have 

£o/C = *oAo*0 =Idj2 . 

We know motivate the introduction of the Hilbert space £ by the following 
claim: 

Proposition 12. The Hilbert space {£, (, )) is a reproducing kernel Hilbert 
space (RKHS) with W^^'^-valued reproducing kernel C , the covariance func- 
tion of the process X . 

Proof. Consider the problem of finding all elements u oi £ solution of 
the equation C[u\ = v for v in Lj. The operator /C provides us with a 
continuous M'^^ "^-valued kernel function k 

V(t,s) G U\ kit,s) = l[o,t]{s)git)- f{s), 

which is clearly the Green function for our differential equation. This entails 
that the following equalitiy holds for every u in £ 

u{t) = / k{t,s)C[u]{s)ds. 
Ju 
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Moreover, we can decompose the kernel k in the sense as 



since we have 



k{t,s) 



/C 



{n,k)£X 

= Yl ^\.^n,k]{t) ■ 4>l.,k{s) , 

{n,k)eX 

withs 6s = 6{- —s). Then, we clearly have 

C{t,s)= k{t,u) ■ k{s,u)'^ du = Y V'n,fc(i) • 
^ {n,k)ex 

where we recognize the covariance function of X, which implies 

k{t, S)= Y ^n,k{t) ■ C {S) = C [C(t, • )] . 

(n,A;)eX 

Eventually, for all u in we have: 

u{t)= [ C[Cit,-)]{s) ■ C[u]is)ds = V{Cit,-),u) , 
Ju 

where we have introduced the P-operator associated with the inner product 
(,): for ah M"'^' '^-valued funct ions A and B defined on U such that the 
columns Ci{A) and Ci{B), < i < d, are in £, we define the matrix 'P{A, B) 
in M'^^'^ by 

VO < i,j < d, V{A,B),,, = {c,iA),Cj{B)) . 

By the Moore- Aronszajn theorem [2], we deduce that there is a unique repro- 
ducing kernel Hilbert space associated with a given covariance kernel. Thus, 
£ is the reproducing subspace of Cq[U,W^) corresponding to the kernel C, 
with respect to the inner product (, ). □ 
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Remark 4. From a more abstract point of view, it is well-know that 
the covariance operator of a Gaussian measure defines an associated Hilbert 
structure [34]. 

In the sequel, we will use the space E as the ambient Hilbert space to 
define the finite-dimensional sample-paths spaces as a nested sequence of 
RKHS. More precisely, let us write for the finite-dimensional subspace 
off 

fjv = G Co(?7,]R'^) I £M G , 
with the space l?^ ^ being defined as 

L| jv = span [{ci((/)n,fc)}„,fc6i^,o<i<d 

We refer to such spaces as finite-dimensional approximation spaces, since we 
remark that 



Efq = span 



which means the space £n is made of the sample space of the finite di- 
mensional process Xtv- The previous definition makes obvious the nested 
structure <?o C <?i C • • • C i?, and it is easy to characterize each space £]y as 
reproducing Hilbert kernel space: 

Proposition 13. The Hilbert spaces ((fjv,(,)) are reproducing kernel 
Hilbert space (RKHS) with W^^'^-valued reproducing kernel Cn , the covari- 
ance function of the process X^- 

Proof. The proof this proposition follows the exact same argument as 
in the case of £, but with the introduction of finite-dimensional kernels 

y{t,s)eU^, kN(,t,s)= Yl V^n,fc(t) • , 

(n,fc)eljv 

and the corresponding covariance function 

V(t,s) G [0,1]2, CN{t,s)= V'n,fc(i) • ■ 

(n,fc)eljv 

□ 
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3.2.2. Finite-Dimensional Processes as Orthogonal Projections. The frame- 
work set in the previous section offers a new interpretation of our construc- 
tion. Indeed, for ah > 0, the column of {''Pn,k}{n,k)&XM form an orthonor- 
mal basis of the space £j\f: 

This leads to define the finite-dimensional approximation xjy of an sample 
path a; of i5 as the orthogonal projection of x on iSat with respect to the 
inner product (,). At this point, it is worth remembering that the space £ 
is strictly contained in ^f^' and does not coincide with x^': actually one can 
easily show that P(<?) = 0. We devote the rest of this section to define the 
finite-dimensional processes = '^n [X] resulting from the conditioning 
on D]\f, as path- wise orthogonal projection of the original process X on the 
sample space £n- 

Proposition 14. For any N > 0, the conditioned processes E^v [X] can 
be written as the orthogonal projection of X on £n with respect to (,) 

^n[X]= 1pn,k-r{lpn,k,X). 

{n,k)eXi^ 

The only hurdle to prove Proposition 14 is purely technical in the sense 
that the process X lives in a larger space than £: we need to find a way 
to extend the definition of (, ) so that the expression bears a meaning. Be- 
fore answering this point quite straighforwardly, we need to establish the 
following lemma: 

Lemma 5. Writing the Gauss-Markov process Xt = Jq k{t, s) dWs, for 
all N > 0, the conditioned process = Ea? [X] is expressed as the stochas- 
tic integral 

Z^ = I kNit,s)dWs with kNit,s)= ^n,k{t) ■ (t>l,As) . 

° {n,k)eXN 

Proof. In the previous section, we have noticed that the kernel kjsf con- 
verges toward the kernel k (Green function) in the sense: 

Ht,s) = Y '^n,k{t) ■ 4)n,k{s) 
{n,k)el 

= lim V 1pn,k{t) ■ cl>l,kis)kN 

(n,A;)eI]v 

= lim fcvft, s) . 

N^oo 
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This implies that the process X as the stochastic integral, can also be written 
as 

Xt = g{t) [ lioAs)f{s)dWs= [\{t,s)dWs= lim f\N{t,s)dWs. 
Ju Jo Jo 

Specifying the decomposition of k^, we can then naturally express X as the 
convergent sum 



= y2 '^n,k-'Sn,k with Sn,k= / 4>n I 

/ . Jo 



is) dWs , 



where the orthonormality property of the (f}n,k with respect to (,), makes 
the vectors Sn,k appears as independent d-dimensional Gaussian variables 
of law M{0, Id)- It is then easy to see that by definition of the elements i/'n,fc) 
for almost every u in il., we then have 

ViV>0,0<t<l, =Eiv[X](aj) = Yl V'n,fc-3n,fcM, 

(n,A;)eIjv 

and we finally recognize in the previous expression that for all < t < 1 



Zf= V ,Pn,k-'Sn,k= V ll^n,k{i)- I 4>lk{s)dWs= C kN{t^s)dWs. 
1~Z^ , 777^ JU Jo 



H — 

{n,k)£lff {n,fe)elj\ 



□ 

We can now proceed to justify the main result of Propositon 14: 

Proof. The finite-dimensional processes defined through Lemma 5 
have sample-paths 1 1— )• (uj) belonging to £n- Moreover, for almost every 
U! in Q, and for all n, k in X^r, 



\lJs)dWs{u) 







because of the orthonormality property of 'j/'n,A; with respect to (,). As the 
previous equalities holds for every N > 0, the applications x i— t- Vi^l^n^k^^) 
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can naturally be extended on by continuity, Therfore, it makes sense to 

write for all (n, k) inlN, V{ipn,k, Z^) = liniTv^oo 'P{ipn,k, Z^) 7'('0n,fc, X) 
even if the X is defined into a larger sample space than £. In other words, 
we have 

V{lPn,k, X)= f Cf>lkis) dWs = 3„,fc , 

Jo 

and we can thus express the conditioned process Z'^ = [X] as the or- 
thogonal projection of X onto the finite sample-path £]\r by writing 

Z^= '4^n,k-V{ll^n,k,X). 

(n,fc)6ljv 

□ 

3.2.3. Optimality Criterion of the Sample Paths. Proposition 14 eluci- 
dates the structure of the conditioned processes Zi\f as path-wise orthogonal 
projections of X on the finite-dimensional RKHS £n. It allows us to cast 
the finite sample-paths in a geometric setting and incidentally, to give a 
characterization of them as the minimizer of some functionals. In doing so, 
we shed a new light on well-known results of interpolation theory [26, 43, 53] 
and extend them to the multidimensional case. 
The central point of this section reads as follows: 

Proposition 15. Given a function x in 8, the function x n = {'^ o A.]\j) [x] 
belongs to 8^ and is defined by the following optimal criterion: x^ is the 
only function in £ interpolating x on such that the functional 

(3.3) {y^y) = \\C[y]{t)h''= [\c[ym\,'dt, 

Jo 

takes its unique minimal value over E in x^. 

Proof. The space Sjy has been defined as Sn = [^^n] = ° [S], 
so that for all x in £, xj^j clearly belongs to S^. Moreover, xjsf interpolates x 
on D^: indeed, we know that the finite-dimensional operator A^v and "^jl 
are inverse of each other A^r = , which entails that for all t in 

Xpf{t) = (* o Ajv) [X]{t) = (*7V o Atv) [x]{t) = x{t) , 

where we use the fact that for any ^ in ^17', and for all t in D^, ^N[^]{t) = 
*[^](t) (recall that ipn,k{t) = if n > N and t belongs to I) at). 
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Let us now show that is determined in 8 by the announced optimal 
criterion. Suppose y belongs to £ and interpolates x on and remark 
that we can write 



{y,y) = \my] 



(*oA)[y](t)||2' = ||A[y]||2^ 



since $ is an isometry. Then, consider A[y] in /^(^ri) and remark that, since 
for all (n, k) in X^v, Sn,k sue Dirac measures supported by Djsf, we have 

V {n,k) G In , A„^fc[y] = P(5„,fc,y) = P(5„,fc,a;) = An^k[x] = An^k[xN] ■ 

This entails 

\\A[y]\\2^dt= J2 \^n,k[y]\2^> Yl l^nAyh^ = \\^[XN]\\2^dt. 

{n,k)&X {n,k)&Xff 

since by definition oi x^, ^^^,fe[^c^^] = if n > A^. Moreover, the minimum 
{xn,Xn) is only attained for y such that Sn,k[y] = if n > N and dn,k[y] = 
Sn,k[x] if n < N, which defines univocally xjy. This establishes that for all 
y in £ such that for all t in Dn, y(t) = x{t), we have {xj\f,xj\f) < {y,y) 
and the equality case holds if and only ii y = x^. □ 

Remark 5. When C represents a regular differential operator of order 
d, Yli=i 0'i{'t)D^ where D = that is for 



dXt = a{t) ■ Xt + Vr(i) • dWt , 



with 



ait) 



1 

ai 



the finite-dimensional sample paths coincide exactly the spline interpolation 
of order 2d + l, which are well-known to satisfy the previous criterion [30]. 
This example will be further explored in the example section. 



The Dirichlet energy simply appears as the squared norm induced on £ 
by the inner product (,), which in turn can be characterized as a Dirich- 
let quadratic form on £. Actually, such a Dirichlet form can be used to 
define the Gauss-Markov process, extending the Gauss-Markov property to 
processes indexed on multidimensional spaces parameter [41]. In particular. 
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for a n-dimensional parameter space, we can condition such Gauss-Markov 
processes on a smooth n — 1-dimensional boundary. Within the boundary, 
the sample paths of the resulting conditioned process (the solution to the 
prediction problem in [41]) are the solutions to the corresponding Dirichlet 
problems for the elliptic operator associated with the Dirichlet form. 

The characterization of the basis as the minimizer of such a Dirichlet 
energy (3.3) gives rise to an alternative method to compute the basis as the 
solution of a Dirichlet boundary value problem for an elliptic differential 
operator: 

Proposition 16. Let us assume that a and \/r are continuously dif- 
ferentiable and that \/r is invertible. Then the functions fj,n,k O'T^ defined 
as: 

{^i\t) t £ [ln,k,mn,k] 
fi^'it) t e [mn,k,rn,k] 
else, 

where /x' and /x^ are the unique solutions of the second order d- dimensional 
linear differential equation 

(3.4) u" + (r^i (a^r - r') -«)«'- (r^^ (a^r -T')a + a')u = 

with the following boundary value conditions: 

/^'(^n,fc)=0 ('/X'''(m„,fc) = /d 

fJ'^ {mn,k) = Id [^''(^n.fc) = 

Proof. By Proposition 15, we know that /in,fc(t) minimizes the convex 
functional ^ 

[ \£[u]{s)\2^ ds 
Jo 

over £, being equal to zero outside the interval [ln,k, i"n,k] and equal to one at 
the point t = k- Because of the hypotheses on ct and Vr, we have C = T> 
and we can additionally restrain our search to functions that are twice con- 
tinuously differentiable. Incidentally, we only need to minimize separately 
the contributions on the interval \ln,k-,'>^n,k\ and [m^^^, r„^fc].On both inter- 
vals, this problem is a classical Euler-Lagrange problem (see e.g. [1]) and is 
solved using basic principles of calculus of variations. We easily identify the 
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Lagrangian of our problem as 

-1 



L{t, u, u') 



u'-a{t)u{t)) v/r(*) 



2 



u'{t) - a{t) u{t) ) ^ (r(t)) ^ ( u'{t) - a{t) u{t) 



From there, after some simple matrix calculations, the Euler-Lagrange equa- 
tions 

dLit,u,u') d f dL{t,u,u') \ _^ .^^ ^ 
dui dt \ du'- J ' 

can be expressed under the form: 

u" + (r~^ (a^r - r') -«)«'- (r-^ (a^r - r') a + = o 

which ends the proof. □ 

Remark 6. It is a simple matter of calculus to check that the expression 
of fi given in Proposition 1 satisfies equation (3.4). Notice also that in the 
case T = Id, the differential equation becomes 

u" + (q"^ — Oij u' — {^cx^cx + Q;') u = , 

which is further simplified for constant or symmetrical a. 

Under the hypotheses of Proposition 16, we can thus define fj,n,k as the 
unique solution to the second-order linear differential equation (3.4) with 
the appropriate boundary values conditions. From this definition, it is then 
easy to derive the basis tpn,k by completing the following program: 

1. Compute the t i— t- Hn,k{t) by solving the linear ordinary differential 
problem. 

2. Apply the differential operator D to get the functions 'D[fin,k]- 

3. Orthonormalize the column functions t i— )• Cj(P[/^„^fc(t)]) by Gram- 
Schmidt process. 

4. Apply the integral operator /C to get the desired functions 'ipn,k (or 
equivalently multiply the original function t i— )■ Hn,ki't) by the corre- 
sponding Gram-Schmidt triangular matrix). 

Notice finally that each of these points are easily implemented numerically. 

4. Exemples: Derivation of the Bases for Some Classical Pro- 
cesses. 
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4.1. One-Dimensional Case. In the one-dimensional case, the construc- 
tion of the Gauss-Markov process is considerably simplified since we do not 
have to consider the potential degeneracy of matrix-valued functions. In- 
deed, in this situation, the centered Gauss-Markov process X is solution of 
the one-dimensional stochastic equation 

dXt = a{t) Xt dt + dWt , 

with a homogeneously Holder continuous and T positive continuous func- 
tion. We then have the Doob representation 

Xt = g{t) f f{s)dWs, with g{t) = efo-^''^^\f{t) = ^/T(t)e-fo-(-)'i-. 
Jo 

Writing the function h as 

Ht)= f f\s)ds, 
Jo 

the covariance of the process reads for any < t, s < as 

C{t,s) =g{t)g{s)h{tAs). 
The variance of the Gauss-Markov bridge Bt pinned in tx and tz yields 
2 ^,^,AHt)-h{tx)){h{tz)-h{t)) 



h{tz) - h(tx) 



These simple relations entails that the functions tpn k are defined on their 



supports Sn,k by ^n,k{t? = ^ [{^''{t)? 



with 



n + l,2fc + l (0 (0"«„,fc,m„,fe(i))' 



This reads on Sn+i,2k as 



{Kt)-h{ln,k))[Kr^,k)-Kt)) 
h{rn,k) - Kln,k) 

_ {h{t) - h{ln,k)){h{mn,k) - h{t)) 

K'^n.k) - h{ln,k) 
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and on S'„+i^2fc+i as 

' {h{t) - h{ln,k)){h{rn,k) - h{t)) 



i^n,k{tY = g{ty 



h{rn,k) - h{ln,k) 

{h{t) - h{mn,k)){h{rn,k) - h{t)) 



h{rn,k) - Kn^n,k) 

and therefore we have: 

r (yn,kg{t){h{t) -h{ln,k)) 



1pn,k{t) 



g{mn,k){H^n,k) - h{ln,k)) 

(Tn,kg{t){h{rn,k) - h{t)) 
. gimn,k)iHrn,k) - h{mn,k)) 



ln,k <t<in. 



n,k 



mn,k < t < rn,k , 



with 



{h{rn,k) - h{mn,k)) {h{'^n,k) - h{ln,k)) 



h{rn,k) - Wn,k) 



As for the first element, it simply results from the conditional expectation 
of the one-dimensional bridge pinned in /q o = and rg o = 1: 



^0,0 (i) 



g(t)(/i(t) -/ifao)) 
- h{lo,o) 



In this class of processes, two paradigmatic processes are the Wiener process 
and the Ornstein-Uhlenbeck processes with constant coefficients. In the case 
of the Wiener process, h(t) = t and g{t) = 1, which yields the classical 
triangular-shaped functions Schauder functions used by Levy [36]. As for the 
Ornstein-Uhlenbeck process with constant coefficients a and \/r, we have 
g{t) = exp(at), f{t) = VTexp{-at) and h{t) = ^(1 - e"^"*), yielding for 
the construction basis the expression: 



1pn,k{t) 



and 



sinh(a(t - l^^k)) 
f^y/sinh(a(m„,fc - ln,k)) 
r sinh(a(r^^fc - t)) 

" V^sinh(a(m„,fc - ln,k)) 

re-"/2sinh(Qt) 



^n,k ^ i ^ TIT'Ti^k i 
mnk <t< rnh , 



a ^sinh(a) 



which were already evidenced in [51]. 
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4.2. Multidimensional Case. In the multidimensional case, the explicit 
expressions for the basis functions il^n,k makes fundamental use of the flow 
F of the underlying linear equation (1.3) for a given function a. For com- 
mutative forms of a (i.e such that a{t) ■ q.{s) = a{s) ■ cx{t) for all t, s), the 
flow can be formally expressed as an exponential operator. It is however a 
notoriously difficult problem to find a tractable expression for general a. As 
a consequence, it is only possible to provide closed- from formulae for our 
basis functions in very specific cases. 

4.2.1. Multi-Dimensional Gauss-Markov Rotations. We consider in this 
section o: antisymmetric and constant and \/r G R'^^'" such that T = a^Id- 
Since ot^{t) = —cx.{t), we have: 

F{s,tf = F{s,tr\ 

i.e. the flow is unitary. This property implies that 

hu{s, t) = a"^ I F{w, u)F{w, u)'^ dw = a'^{t - s)Id , 

J s 

which yields by definition of (Jn,k 



fn,k ^n,k 



-Id. 



The square root cr^^k is then uniquely defined (both by choosing Cholesky 
and symmetrical square root) by 



{'mn,k - ln,k){rn,k " "T-„,fc) ^ 

C^n,k = ^\ ; ^ 

V \Tn,k - ln,k) 




^n,k '^n,k 



ij^n,k ^n,k^{j'n,k ^n,k) 



{t — ln,k)F{'m'n,k-,t) , ln,k < t < rrLn^k ■, 



^n,k ^n,k 



{frijk '^n,k){l"n,k ^n,k) 



{rn,k - t)F{mn,k, t) , ln,k < t < ITln, 



k ■ 



Recognizing the (n, k) element of the Schauder basis for the construction of 
the one-dimensional Wiener process 



Sn,fc(t) 



'^n,k ^n,k 



{j'n,k ^n,k^{j^n,k ^n,k) 



nT-n^k ^n,k 



ij'n,k ^n,k){Tn,k '^n,k) 



(^ ^n,fc) ) ^n,k ^ t ^ nT"n,k j 



irn,k - i) , ln,k < t < nin^k , 



T. TAILLEFUMIER AND J. TOUBOUL/GAUSS-MARKOV PROCESSES 49 

1.5 
1 

0.5 


-0.5 
-1 



-1.5 
-2 

-1.5 -1 -0.5 0.5 1 1.5 

Fig 2. Construction of the stochastic sine and cos Ornstein-Uhelenbeck processes for the 
parameters given in equation (4.1); multi-resolution construction of the sample path. 

we obtain the following formula: 

■«/'n,fc(i) = cr Sn,kit) F{t - mn,k) ■ 

This form shows that the Schauder basis for multidimensional rotations 
results from the multiplication of the triangular-shaped elementary function 
used for the Levy-Cesielski construction of the Wiener process with the flow 
of the equation, i.e. the elementary rotation. 

The simplest example of this kind is the stochastic sine and cosine process 
corresponding to: 

(4.1) "=(-1 o) "^""^ Vf = a^l2. 

In that case, ipn,k has the expression 

, _ /,N f cos(t - mn,k) - sin(t - mn,k) \ 

- Sn,k[t) y ^.^^^ _ ^^^^^ ^^^^^ _ ^^^^^ J 

Interestingly, the different basis functions have the structure of the solutions 
of the non-stochastic oscillator equation. One of the equations perturbs the 
trajectory in the radial component of the deterministic solution, and the 
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other one in the tangential direction. We represent such a construction in 
Figure 2 with the additional conditioning that Xi = Xq, i.e. imposing that 
the trajectory forms a loop between time and 1. 

4.2.2. The Successive Primitives of the Wiener Process. In applications, 
it often occurs that people use smooth stochastic processes to model the 
integration of noisy signals. This is for instance the case of a particule subject 
to a Brownian forcing or of the synaptic integration of noisy inputs [52]. 
Such smooth processes involves in general integrated martingales, and the 
simplest example of such processes are the successive primitives of a standard 
Wiener process. 

Let d > 2 and denote by Xf the d — 1th order primitive of the Wiener 
process. This process can be defined via the lower order primitives X^ for 
k < d via the relations: 



1 



dxl 



X^dt 
dWt 



k < d 



where Wt is a standard real Wiener process. These equations can be written 
in our formalism 



dXt = a{t) ■ Xt + ^/Tit) ■ dWt , 



with 



a{t) 



1 






1 



In particular, though none of the integrated processes X'' for K > 1 IS 
Markov by itself, the d-uplet X = {X'^, ...,X^) is a Gauss-Markov process. 
Furthermore because of the simplicity and the sparcity of the matrices in- 
volved, we can identify in a compact form all the variables used in the 
computation of the construction basis for these processes. In particular, the 
flow F of the equation is the exponential of the matrix a, and since a is 
nilpotent, it is easy to show that F has the expression: 



F{s,t) 



1 {t 



2 

(t-s) 

1 
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and the only non-zero entry of the d x d matrix T is one at position (d — 
l,d — 1). Using this expression and the highly simple expression of F, we 
can compute the general element of the matrix hu{t, s), which reads: 

^^-^'^*)kj-^ {2d-l-{i+J)){d-l-^)l{d-l-J)l■ 

Eventually, we observe that the functions Vn.fc yielding the multi-resolution 
description of the integrated Wiener processes, are directly deduced from 
the matrix-valued function 



(Cn,fc(t))i i 



i>n,k ■ \ = g{t)h{ln,k,t) , ln,k < t < TTln^k 



[ti^n,k ■ Rnjc = 9{t)h{t^ Tn,k) ' ^n,k < t < r^^k , 

whose components are further expressed as 

d-1 j_p .2d-l-{p+j) _ fd-l-ip+j) 

(c„,.(i)V,=V(-ir^-- 



p=i 



ii-p)\ {2d - 1 - {p + j)){d - 1 - py.{d - 1 - j) 

for Ink ^ t < inrin k and as 



d-1 i 2d-l-{p+j) _ 2d-l-ip+j) 

l^n,km, ^) i^i-p)l(2d-l-{p + j)){d-l-p)\{d-l-j)\' 

for m„,fc < t < rn^k- The final computation of the i/^n^fc involves the compu- 
tation of -Ln.fe and Rn,k, which in the general case can become very complex. 
However, this expression is highly simplified when assuming that mn,fc is the 
middle of the interval [ln,k,'i^n,k]- Indeed, in that case, we observe that for 
any such that i + j is odd, {hm{l,r))ij = which induces the same 
property on the covariance matrix X)n,fc and on the polynomials {Cn,k{t))i,j- 
This property gives therefore a preference to the dyadic partition that pro- 
vides simple expressions for the basis elements in any dimensions, and allows 
simple computations of the basis. 



Remark 7. Observe that for all < i < d — 1, we have 

d-1 



-1 i 2d-l-{p+j) _ j2d-2-(p+j) 

t ^ ''n,k 



p=i 



{i-p)\ {d-l-p)\{d-l 



^d-j-l (^_^.g^(d-l-^)-p 



m,, {d-j-l)\ 
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As Ln^k and Rn^k are constant, we immediately deduce the important rela- 
tion that for all < i < d— 1, {ipn,k{t))o^j = {4'n,k{'t)) i j ■ This indicates that 
each finite-dimensional sample paths of our construction has components 
that satisfies the non-deterministic equation associated with the iteratively 
integrated Wiener process. Actually, this fact is better stated remember- 
ing that the Schauder basis i/'n,fc and the corresponding orthonormal basis 
: [0, 1] — )■ M^^*^ are linked through the equation (2.4), which reads 



(V'n,fc)o,0 

{'^n,k)'d-2fl 
{'il^n,k)'d-lfl 



'n,k)od-l 



n,k)d-2,d-l 
n,k)d-l,d~l 



('0n,fc)l,O 



+ 



{'4>n,k)d- 









{4>n,k)o,0 



1,0 



{'ipn,k)l,d~l 
{'^n,k)d-l,d~l 







kjOA-l 



Additionally, we realize that the orthonormal basis is entirely determined 
by the one-dimensional families {4>n,k)oji which are mutually orthogonal 
functions satisfying {4>n,k)o,j 



We study in more details the case of the integrated and doubly-integrated 
Wiener process {d = 2 and d = 3), for which closed- form expressions are 
provided in Appendices A and B. As expected, the first row of the basis 
functions for the integrated Wiener process turns out to be the well-known 
cubic Hermite splines [13] . These functions have been widely used in numer- 
ical analysis and actually constitute the basis of lowest degree in a wider 
family of bases known as the natural basis of polynomial splines of interpo- 
lation [32]. Such bases are used to interpolate data points with constraint of 
smoothness of different degree (for instance the cubic Hermite splines ensure 
that the resulting interpolation is in C^[0, 1]). The next family of splines of 
interpolation (corresponding to the constraint) is naturally retrieved by 
considering the construction of the doubly- integrated Wiener process: we ob- 
tain a family of three 3-dimensional functions, that constitutes the columns 
of a 3 X 3 matrix that we denote The top row is made of polynomials of 
degree five, which have again simple expressions when m„^fc is the middle of 
the interval [/n,fc, J^n.fc]- 
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Fig 3. (A) Basis for the construction of the Integrated Wiener process (d = 2). Plain 
red curve: i^i,!, dashed red: "02,1, plain blue: tpi,2 and dashed blue: tp2,2- (B) 10-steps 
construction of the process. We observe that each basis accounts separately for different 
aspects of sample path: ip2,i fixes the value of the integrated process at the middle point 
mn,k and 4:2,2 the value of the derivative of the process at the endpoints {ln,k,rn,k} in 
relationship with the value of the Wiener process at the middle point, whose contributions 
are split between functions -tpi,! and ^pi,2 (see Fig. 3). 
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5. Stochastic Calculus from the Schauder point of view. Thus 
far, all calculations, propositions and theorems are valid for any finite di- 
mensional Gauss-Markov process and all the results are valid path-wise, i.e. 
for each sample path. The analysis provides a Schauder description of the 
processes as a series of standard Gaussian random variables multiplied by 
certain specific functions, that form a Schauder basis in the suitable spaces. 
This new description of Gauss-Markov processes provides a new way for 
treating problems arising in the study of stochastic processes. As examples 
of this, we derive ltd formula and Girsanov theorem from the Schauder 
viewpoint. Note that these results are equalities in law, i.e. dealing with 
the distribution of stochastic processes, which is a weaker notion compared 
to the path-wise analysis. In this section, we restrict our analysis to the 
one-dimensional case for technical simplicity. 

The closed-form expressions of the basis of functions ipn,k in the one- 
dimensional case are given in section 4.1. The differential and integral op- 
erators associated, introduced in section 2.1.2 are highly simplified in the 
one dimensional case. Let U he a bounded open neighborhood of [0, 1], and 
denote by C{U) is the space of continuous real functions on U, R{U) its 
topological dual, the space of Radon measures, Dq(U) the space of test 
function in C^{U) which are zero at zero and it dual Dq{U) C R{U). We 
consider the Gelfand triple 



The integral operator K. is defined (and extended by dual pairing) by: 



Now that we dispose of all the explicit forms of the basis functions and 
related operators, we are in position to complete our program, and start by 
proving the very important Ito formula and its finite-dimensional counter- 
part before turning to Girsanov's theorem. 

5.1. Ito's Formula. A very useful theorem in the stochastic processes 
theory is the Ito formula. We show here that this formula is consistent with 
the Schauder framework introduced. Most of the proofs can be found in 
the Appendix E. The proof of Ito formula is based on demonstrating the 
integration by parts property: 



Dq{U) C C{U) C L^{U) C D'q{U) C R{U) 




and the inverse differential operator "D reads: 
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Proposition 17 (Integration by parts). Let {Xt) and {Yt) he two one- 
dimensional Gauss-Markov processes starting from zero. Then we have the 
following equality in law: 

XtYt= [ XsodYs+ pYsodXs 
Jo Jo 

where Jq AgodBg for At and Bt two stochastic processes denotes the Stratonovich 
integral. In terms of ltd 's integral, this formula is written: 

Xt Yt = f XsdYs + [ YsdXs + {X, Y)t 
Jo Jo 

where the brackets denote the mean quadratic variation. 

The proof of this proposition is quite technical and is provided in Ap- 
pendix E. It is based a thorough analysis of the finite-dimensional processes 
Xt^ and Yt^ . For this integration by parts formula and using a density 
argument, one can recover the more general Ito formula: 

Theorem 18 (Ito). Let {Xt)t be a Gauss-Markov process and F G 
C^(M). The process f{Xt) is a Markov process and satisfies the relation: 

(5.1) f{Xt) = f{Xo) + r f'{Xs)dXs + \ f f"{Xs)d{X), 

Jo ^ Jo 

This theorem is proved in the Appendix E. 

Ito's formula implies in particular that the multi-resolution description 
developed in the paper is valid for every smooth functional of a Gauss- 
Markov process. In particular, it allows a simple description of exponential 
functionals of Gaussian Markovian processes, which are of particular interest 
in mathematics and has many applications, in particular in economics (see 
e.g. [18]). 

Therefore, we observe that in the view of the article, Ito's formula stems 
from the non-orthogonal projections of the basis elements the one on the 
other. For multidimensional processes, the proof of Ito's formula is deduced 
from the one-dimensional proof and would involve study of the multidimen- 
sional bridge formula for Xt and Yt. 

We eventually remark that this section provides us with a finite-dimensional 
counterpart if Ito's formula for discretized processes, which has important 
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potential applications, and further assesses the suitability of using the finite- 
resolution representation developed in this paper. Indeed, using the frame- 
work developed in the present paper allows considering finite-resolution pro- 
cesses and their transformation through nonlinear smooth transformation 
in a way that is consistent with the standard stochastic calculus processes, 
since the equation on the transformed process indeed converges towards its 
Ito representation as the resolution increases. 

5.2. Girsanov Formula, a geometric viewpoint. In the framework we de- 
veloped, transforming a process X into a process Y is equivalent to substi- 
tuting the Schauder construction basis related to Y for the basis related to 
X. Such an operation provides a path-wise mapping for each sample path of 
X onto a sample path of Y having the same probability density in ^Q' . This 
fact shed a new light on the geometry of multi-dimensional Gauss-Markov 
processes, since the relationship between two processes is seen as a linear 
change of basis. In our framework, this relationship between processes is 
straightforwardly studied in the finite-rank approximations of the processes 
up the a certain resolution. Technical intricacy are nevertheless raised when 
dealing with the representation of the process itself in infinite dimensional 
Schauder spaces. We solve these technical issues here, and show that in the 
limit N ^ oo one recovers Girsanov's theorem as a limit of the linear trans- 
formations between Gauss-Markov processes. 

The general problem consists therefore in studying the relationship between 
two real Gauss-Markov X and Y that are defined by: 



We have noticed that the spaces '^^^ the same in the one-dimensional case 
as long as both Fx and Ty never vanish, and therefore make this assumption 
here. In order to further simplify the problem, we assume that 'Jx,y = ^x/^Y 
is continuously differentiable. This assumption allows us to introduce the 
process Zf = 7x,y(i)^ that satisfies the stochastic differential equation: 



dXt 
dYt 




dZt = — ilxAi)) Yt dt + -ixA^Wt 




-t: irixA^)) + 7x,y(i)ay(t) ]Ytdt + ^/V x{t) dWt 



= az{t)Ztdt + ^Vx{t) dWt 
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with az{t) = ^ (7x,y(0)7x,y(i)~^ + ay(i)- Moreover, if zipn,k and y^n./fc 
are the basis of functions that describe the process Z and Y respectively, we 

have z1pn,k = lx,Y ■ Ylpn,k- 

The previous remarks allow us to restrict without loss of generality our study 
to processes defined for a same function y/V, thus reducing the parametriza- 
tion of Gauss-Markov processes to the linear coefficient a. Observe that in 
the classical stochastic calculus theory, it is well-known that such hypothesis 
are necessary for the process X to be absolutely continuous with respect to 
Y (through the use of Girsanov's theorem). 

Let us now consider a, j3 and \/r three real Holder continuous real functions, 
and introduce aX and pX solutions of the equations: 



All the functions and tools related to the process q,X (resp ^X) will be 
indexed by „ {p) in the sequel. 

5.2.1. Lift Operators. Depending on the space we we are considering 
(either coefficients or trajectories), we define the two following operators 
mapping the process on pXt 

1. The coefficients lift operator o^/^G is the linear operator mapping in 
^Q.' the process on the process pX: 



For any ^ G ^f]', the operator a,pG maps a sample path of aX on a 
sample path of pX. 
2. The process lift operator a,pF is the linear operator mapping in 
the process aX on the process ^X: 



We summarize the properties of these operators now. 

Proposition 19. The operators a,i3G and a,pH satisfies the following 
properties: 

i. They are linear measurable bijections, 

a. For every N > 0, the function a^pG^ = Pn ° a,i3G o Ijy : ^0'^ — )• ^Otv 
(resp. a,pHN = Pn ° a,pH o /jy : ^Vl'j^ — )• (P,n) is a finite- dimensional 




a 



a 



= o „A : (,f], B {^n)) ^ (,f], B {^n)) 
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linear operator, whose matrix representation is triangular in the nat- 
ural basis of (resp. ^^'j^) and whose eigenvalues a,p^n,k o,re given 
by 

gaimn,k) l3Mn,k „ , , n ^ I ^ oN-1 

a,l3Vn,k = 7 ' Q<n<N, 0<k<2 

9l3[rnn,k) a^n,k 

(resp. i3,al^n,k = (a,/3^'n,fc)"V- 

Hi. a,pG and a,/3H are bounded operators for the spectral norm with 



sup ga sup /, 



M",K \\o = S'^PS'^Pa,^^n,k<—r . r .2 < 

n k inf5/3 mf/^ 

and \\a,l3H\\^ = ||^,aG||2 < oo. 
iv. the determinants of a,i3G]\f (denoted a, ^Jn) dn-d a,i3HN admit a limit 
when N tends to infinity: 

a^pJ = lim^a,i3JN = exp (^j {a{t) - I3{t))dt 

and 

^lim^det(a,/3i^Ar) = exp Q {P{t) - a{t)) dt^^ = p,aJ ■ 

The proof of these properties elementary stem from the analysis done 
on the functions ^ and A that were previously performed, and these are 
detailed in Appendix C. 

5.2.2. Radon Nikodym Derivatives. From the properties proved on the 
lift operators, we are in position to further analyze the relationship between 
the probability distributions of and pX. We first consider the finite- 
dimensional processes and pX^ . We emphasize that throughout this 
section, all equalities are true path-wise. 



Lemma 6. Given the finite- dimensional measure andP^ , the Radon- 
Nikodym derivative of P^ with respect to P^ satisfies 

dP^ / 1 / y . . N \ 

with a,i3SN = a,i3GN'^ ' a,(5GN o,nd the equality is true path-wise. 
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Proof. In the finite-dimensional case, for all > 0, the probability 
measures , \Pa \ Lebesgue measure on ^^"^ are mutually 

absolutely continuous. We denote and the Gaussian density of 
and P^ with respect to the Lebesg ue measure on • The Radon-Nikodym 
derivative of P^ with respect to P^ is defined path-wise and is simply given 
by the quotient of the density of the vector {^X^(mj j)} with the density 



of the vector {„X^(mij)} for < i < iV, < j < 2*-\ that is 



dP^ p^iaX^iu)) 



We first make explicit 

det(aSAr) J w V 

det(^S^) = detUS^.,E^), 

= det {c,^N ■ a^TV^ • /^Atv^ • ^A^) , 

= det {/sAn ■ a^-TV • a'^N^ ' /^A^v^) , 

= det {a^pGN ■ a^pGN^) , 

= det {a,l3GNf ■ 

Then, we rearrange the exponent using the Cholesky decomposition 

/35]^^ — a^~[^ = P^n'^ ■ /^Aat — oAn'^ ■ qAtv , 

SO that we write the exponent of (5.2) as 

oXn'^ (^Aat"^ • pA^ - oAn'^ ■ oAat) oiXn , 



N -a^N (/3A7V ■ /^An — oAn ■ oAn) a^N{^) ■ "^N 

N ■ 



We finally reformulate (5.2) as 



= a^l^J^ ■ (^~\ (sAr(a;)^ [a^pGn'^ ■ a,pGN - Id^n^) -N{^)j^ 



□ 
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Let us now justify from a geometrical point of view why this formula is 
a direct consequence of the finite-dimensional change of variable formula on 
the model space ^CIn- If we introduce a^N the coefficient application related 
to Q,X^, we know that H^r = a^Nia^^) follows a normal law J\f{0, I^Qj^). 
We denote its standard Gaussian density with respect to the Lebesgue 
measure on . We also know that 

Since p^qGn is linear, the change of variable formula directly entails that 

l3,a.GN{^N) admits on ^0,^ 

as density with respect to the Lebesgue measure. Consider now B a mea- 
surable set of {x^Nt ^^{x^n)), then we have 



NIC ^ Pi ' 

r p^J^An{X^)) 
~ 1b pf(.A^(X^)) '^^"^^ ^' 

from which we immediately conclude. 

5.2.3. The Trace Class Operator. The expression of the path-wise ex- 
pression of the Radon-Nikodym extends to the infinite-dimensional repre- 
sentation of aX and pX. This extension involves technical analysis on the 
infinite-dimensional Hilbert space /^(M). We have shown in Proposition 19 
that the application a,i3G was bounded for the spectral norm. This property 
will allow us to prove that the infinite-dimensional Gauss-Markov processes 
are absolutely continuous and to compute the Radon-Nikodym derivative 
of one measure with respect to the other one, proof that will essentially be 
comparable to the proof of Feldman-Hajek theorem (see e.g. [12, Theorem 
2.23]). 

We have for any ^ in /^(M), the inequality 

\WfiGm2<\\a,pGh-m\2 
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implying that a,iiG maps /^(M) into Z^(IR). We can then define the adjoint 
operator a,i3G'^ from /^(M) to /^(M), which is given by: 

V e, ^ G W , UpG^iv),^) = iv, a,pG{0) ■ 

Let us now consider the self-adjoint operator q^^S = a,pG'^ o a,pG : /^(M) — )• 
/■^(M). This operator is the infinite dimensional counterpart of the matrix 

Lemma 7. Consider the coefficients of the matrix representation of a^pS 
in the natural basis en^k of given as a,i3Sp^g = {e-n,ki a,i3S{ep^q)) , we 

have 
(5.3) 



a 



{t) - m) , I ^ , - m) 



Proof. Assume that max(n,p) < N and that {n,k) and {p,q) G In- 
With the notations used previously with U an open neighbourhood of [0, 1], 
we have: 



a,P^plq — ya,pG{en^k) J a, pG{ep^q) 
(5.4) = / i35ij{t)a'ipn,k{'t)dt / i3Sij{t)a'll^p^q{t)dt 



Since we have by definition aV'n.fc = afC[a4'n,k], p^ij = pT^[p(t)ij] and ^/C ^ 
aV* and pD~^ = pK,* on the space Dq{U), we have 



(5.5) i3(l)ij{t) = plC*ySij]{t) = fp{t) gp{s) p5ij{s)ds , 

Ju 

(5.6) a4'n,k{t) = a^*[a^n,fe](t) - ^ ( OLi'n,k{t) 



fait) dt V ffa(t) 

Prom there using (5.5), we can write the integration by parts formula in the 
sense of the generalized functions to get 

(5,7) l,w.*mt = ,,,,(t),t 

l3'D*[ai^n,k]it)lS<Pi,j{t)dt. 

U 
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We now compute using (5.6) 

(r. Q^ = 9a{t)f{t) , . _d_f ga{t) \ ai)n,k{t) 

^ ■ ^ gp{t)fp{tr'^^^ dt\gp{t)) gp{t)fp{t) 

Specifying g^^ g/3, fa and and recalling the relations 

ga{t)fa{t)=gp{t)Mt) = Vm and I (^^) = (a(t) - /3(t)) ill , 

we rewrite the function (5.8) in L^[0, 1] as 

,V U^„,,](t) = ^— ^ j = .^„,(t) + -^jf^^^nAt) ■ 

Now, since the family i34>n,k forms a complete orthonormal system of L^[0, 1] 
and is zero outside [0, 1], by Parseval identity, expression (5.4) can be written 
as the scalar product: 

which ends the proof of the lemma. □ 
Notice that we can further simplify expression (5.3) 

cps;'^ = s;:^ + 1' ("(^)^-^^(^)) (,v>,,,(t),V'p,g(0) dt+ 

(a{t) - /3{t)) 

(5.9) ^ ^ " ( (t) ai'p,q{t) + a4'p,q{t) aV'n.fc (*)) dt . 

Jo \/r(i) 

We are now in a position to show that the operator — Id can be seen as 
the limit of the finite dimensional operator a.tiS^ — Id^nMi the following 
sense: 

Theorem 20. The operator a,i3S — Id : P{R) — ^ P{R) is a trace class 
operator, whose trace is given by: 

(5.10) TtU,pS-Id)= [\a{t)-m)dt+ !^{a{t) - mf dt 

■JO Jo Ja{t) 

We prove this essential point in Appendix F. The proof consists in showing 
that the operator a,pS — Id is isometric to a Hilbert-Schmidt operator whose 
trace can be computed straightforwardly. 
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5.2.4. The Girsanov Theorem. We now proceed to prove the Girsanov 
theorem by extending the domain of the quadratic form associated with 
a^lsS — Id to the space gil', which can only be done in law. 

Theorem 21. In the infinite dimensional case, the Radon- Nikodym deriva- 
tive of Pp = -PjX^i ^^^^ respect to Pa = P reads 
(5.11) 
dPp{uj) 



exp 



dPaioo) 

which in terms of ltd stochastic integral reads: 

GXp 1/ 9/\ / \ 



dPaiuj) " V7o fait) gait) V 9ait) 

1 im-C^it)f faXtico)^'' 



fa\t) V 9ait) 



dt 



In order to demonstrate the Girsanov theorem from our geometrical point 
of view, we need to establish the following result: 

Lemma 8. The positive definite quadratic form on /^(M) x /^(M) associ- 
ated with operator a^pS — Id : /^(R) — t- /^(M) is well-defined on . Moreover 
for all ^Vt' , 

i^,ia,pS-Id^n')i^) = 

1 ait) - m aXtii) ^ ^ f aXtiO \ ^ iait) - ( aMO \ ^ 



fa it) gait) V 9ait) J Jo fa\t) \ gait) 

where aXtiC) = a^iC) dn-d o refers to the Stratonovich integral and the 
equality is true in law. . 

Proof of Theorem 21. We start by writing the finite-dimensional Radon- 
Nikodym derivative 

dPpioo) ^ 

dPaiio) 

(5.12) a,i3JN ■ lim exp ( --^ (HAr(a;)^ ia,i3SN - Mhjv) '^Ni^^)) ) • 
By Proposition 19, we have 

1 

a,i3J = hm a,pJN = ^ I (a(t) - /3(t)) . 
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If, as usual, H denotes a recursively indexed infinite-dimensional vectors of 
independent variables with law M{0, 1) and H^y = ^Pn ° ^) writing ^ = 
Sn,fc(w), we have 

N N 

12 12 ^ Yl Cn,k[a,l3SN- Id^nN]2g^p,q- 

n=0 p=0 0<fc<2"-i 0<(3<2J^i 

We know that ^ is almost surely in ^0,' and, by Lemma 8, we also know that 
on ^i}' X ^$7': 

lim (C, {a,pSN - Id nf,){0) = {a,i3S - Id q>){^)) , 
r\ —^oo 

SO that we can effectively write the infinite-dimensional Radon-Nikodym 
derivative on ^Q' as the point-wise limit of the finite dimensional ones on 
^^In through the projectors ^Pn- 

dPp, , , dP^ , , 
dp-J''^ = r^'ZodP^^''^ 

which directly yields formula (5.11) 

The derivation of Girsanov formula (5.12) from (5.11) comes from the 
relationship between Stratonovich and Ito formula, since the quadratic vari- 
ation of aXt/ga{t) and (a(t) - I3{t))/ fl{t) x aXt/ga{t) reads 

[' e( f Uis)dWs,^^^l^j^ f Uis)dWs) = f\a{t)-m)dt. 

Jo \J0 Ja [t) Jo J Jo 

Therefore, the expression for the Radon-Nikodym derivative in Lemma 8 
can be written in terms of Ito integrals 

(e, („,^5 - /d,f7')(0 = («(t) - m) dt 

Jo 



/o Pit) gUt) V 9ait) J Jo Pit) V 9ait) 
and the Radon-Nikodym derivative: 

dPp, , ( m-otit) aXtiio) J Moo) 

'^-(w) = exp ( / — ^^y^^ nr^di 



dPa" ' \Jo fa\t) gait) \ gait) 

1 (/3(i)-a(i))2 / Xt(a;)^' 



2 Jo fa\t) V 9ait) 



dt 



□ 
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Observe that if a{t) = 0, we recover the famihar expression 

Conclusion and Perspectives. The discrete construction we present 
displays both analytical and numerical interests for further applications. 
From the analysis viewpoint, three Haar-like properties make our decompo- 
sition particularly suitable for certain numerical computations: i) all basis 
elements have compact support on an open interval that has the structure of 
dyadic rational endpoints; ii) these intervals are nested and become smaller 
for larger indices of the basis element, and iii) for any interval endpoint, 
only a finite number of basis elements is nonzero at that point. Thus the 
expansion in our basis, when evaluated at an interval endpoint (e.g. dyadic 
rational), terminates in a finite number of steps. Moreover, the very nature 
of the construction based on an increasingly refined description of the sam- 
ple paths paves the way to coarse-graining approaches similar to wavelet 
decompositions in signal processing. In view of this, our framework offers 
promising applications: 

Dichotomic Search of First Hitting-times. The first application we envis- 
age concerns the problem of first-hitting times. Because of its manifold ap- 
plications, finding the time when a process first exits a given region, is a 
central question of stochastic calculus. However, closed-form theoretical re- 
sults are scarce and one often has to resort to numerical algorithms [10]. 
In this regard, the multi-resolution property suggests an exact scheme to 
simulate sample paths of a Gaussian Markov process X in an iterative 
"top-down" fashion. Assume the intervals are dyadic rational, and that 
we have a conditional knowledge of a sample path on the dyadic points 
of Dn = {A;2~^|0 < k < 2^}, one can decide to further the simulation of 
this sample path at any time t in -Dat+i by drawing a point according to 
the conditional law of Xt knowing {Xt}^^jj^, which is simply expressed in 
the framework of our construction. This property can be used to great ad- 
vantage in numerical computations such as dichotomic search algorithms for 
first passage times: the key element is to find an estimate of the true condi- 
tional probability that a hitting time has occurred when knowing the value 
of the process at two given time, one in the past and on in the future. With 
such an estimate, an efficient strategy to look for passage times consists in 
refining the sample path when and only when its trajectory is estimated 
likely to actually cross the barrier. Thus the sample path of the process is 
represented at poor temporal resolution when far from the boundary and 
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at increasingly higher resolution closer to the boundary. Such an algorith- 
mic principle achieves a high level of precision in the computation of the 
first hitting time, while demanding far less operation than usual stochastic 
Runge-Kutta scheme. Note that this approach has been successfully imple- 
mented for the one-dimensional case [50] and at stake is now to generalize 
to the computation of exit times in any dimension and for general smooth 
sets [4, 5, 23]. 



Gaussian Deformation Modes in Nonlinear Diffusions. The present study 
is developed for Gauss-Markov systems. However, many models arising in 
applied science present nonlinearities, and in that case, the construction 
based on a sum of Gaussian random variable will not generalize. However, 
the Gaussian case treated here can nevertheless be applied to perturbation 
of nonlinear differential equations will small noise. Let : R x M*^ i— )• M'^ 
be a nonlinear time- varying vector field and let us assume that Xo(i) is a 
stable (attractive) solution of the dynamical system: 

This function Xq can for instance be a fixed point (in which case it is a 
constant), a cycle (in which case it is periodic) or a general attractive orbit of 
the system. In the deterministic case, any solution having its initial condition 
in a given neighbourhood i3 in R x M'^ of the solution will asymptotically 
converge towards the solution, and therefore perturbations of the solutions 
are bounded. Let us now consider that the system is subject to a small 
amount of noise and define Y S the solution of the stochastic nonlinear 
differential equation: 



dYt = F{t, Yt) dt + e^/T{t,Yt)dWt 

Assuming that the noise is small (i.e. e is a small parameter), because of 
the attractivity of the solution Xo^t), the function Y{t) will remain very 
close to XQ{t) (at least in a bounded time interval). In this region, we define 
eZt = Yt — Xo(t). This stochastic variable is solution of the equation: 

1 



dZt = -[ F{t, Xo{t) + eZt) - F{t, Xo{t) + e^/T{t,Xo{t) + eZt)dWt 



= {V,F){t,Xo{t))Zt + ^T{t,Xo{t))dWt + 0(e) 

The solution at the first order in e is therefore the multidimensional Gaussian 
process with non-constant coefficients: 



dZt = (V,.F)(t, Xoit))Zt + y/Tit,Xo{t))dWt . 
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and our theory describes the solutions in a multi-resolution framework. No- 
tice that, in that perspective, our basis functions 'ipn,k can be seen as in- 
creasingly finer modes of deformation of a deterministic trajectory. This 
approach appears particularly relevant to the theory of weakly intercon- 
nected neural oscillators in computational neuroscience [27]. Indeed, one of 
the most popular approach of this field, the phase model theory, formally 
consists in studying how perturbations are integrated in the neighborhood 
of an attracting cycle [19, 20]. 

The present paper proposes a very convenient way of defining finite- 
dimensional approximations of Gauss-Markov processes that are optimal 
in the sense of being minimizers of the Dirichlet energy, and that is consis- 
tent with standard concepts of stochastic calculus. It also sheds new light 
on the structure of the space of Gauss-Markov processes, by the study of 
the operators transforming a process into another, which can be seen as an 
infinite-dimensional rotation in the space of coefficients. The exploration of 
this new view might help further uncovering the geometric structure of this 
space. All these instances are exemplar of how our multi-resolution descrip- 
tion of Gauss-Markov processes offers a simple yet rigorous tool to broach 
open problems, promising original applications in theoretical and applied 
sciences. 
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APPENDIX A: FORMULAE OF THE BASIS FOR THE INTEGRATED 

WIENER PROGES 

In the case of the primitive of the Wiener process, straightforward linear 
algebra computations leads to the two basis of functions ((V'n,fc)i,i, (^n,fc)2,i) 
and {{ipn,k)i,2, (V'n,fc)2,2) having the expressions: 
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(V'n,fc)l,l(i) 



(0"n,fc) 
(<7„„fc) 



1,1 



t - I 



n,k 



1,1 



fn,k '^n,k 



1 + 2 



1 + 2 



mn,k - t 

f^n,k ^n,k 

t - mn,k 

fn,k n^n,k 



J'n,k <t< mn,k 



{i^n,k)2,l{t) 



I ^ ^ {t-ln,k){'mn,k-t) 

(.fn.fcjl,! D -. — Tg , ln,fe S t < "n^n.fc 

y^n,k '"n,k ) 

I . Jrn,k-t){t-mn,k) 

- \Pn,k)\,\ — , mn.k <t< rn,k 



{rn,k - mn,kT 



{tpn,k)l,2it) 



i'^n,k)2,2it) 



where 



-(0-n,fc)2,2 imn,k " t) 
(0"n,fc)2,2 (t - mn,k) 



t - I 



n,k 



[0'n,k)2,2 



^n,k ^n.k 
^n,k i 

1^n,k 1^n,k 
2 



ln,k <t< rrink 



{'^n,k) 



2,2 



^n,k ^n,k 

rn,k - t 

fn,k n^n,k 



1 - 2 



1 - 2 



'mn,k - t 

t ln,k 

t - rrin^k 

fn,k t 



ln,k <t< TUn^k 
mnh < t < rn,k 



(o-n,fe)l,l = \l Y^^'^^'^k - ln,k)'^ 



and (cr„,fc)2,2 



22 (^^5^ ^Th^k^ 



are the diagonal components of the (diagonal) matrix cr^ ^ As expected, we 
notice that the differential structure of the process is conserved at any finite 
rank, since we have: 



^((V'n,fe)l,l(t)) = (^„,fc)2,l(t) , ^((V'n,fc)l,2(t)) = ('0n,fc)2,2 (t) • 

APPENDIX B: FORMULAE OF THE BASIS FOR THE 

DOUBLY-INTEGRATED WIENER PROOFS 

For the doubly integrated Wiener process, the construction of the three 
dimensional process involves a family of thee 3-dimensional functions, which 
constitutes the columns of a 3 x 3 matrix that we denote ip. This basis has 
again simple expression when mn,k is the middle of the interval \ln,k-,rn,k]'- 



d 
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(V'n,fc)l,2(i) 
(V'n,fc)l,3(i) 
(V'n,fc)2,l(i) 
('0n,fc)2,2(i) 
(^n,fc)2,3(0 
(V'n,fc)3,l(i) 
(V'n,fc)3,2(i) 



60 (r, 

12(r„fc'3„fc)5/2 (^".fc - (2 r„,fc + ln,k - 3 t) (r„,fc + - 2 1) 
-|^2 ^)5/2 i^n,k ~ i)'^ {^n,k + 2 Z„ ;j — 3 t) (r^^fc + ln,k ~ 2 t) 

^TI 37 ~i5/2 ^n,fe)' (2 1 A; ^n,k^n,k ~l~ ^n,fc 3 i) {fn,k ~l~ ^n,fc 2 1) 

T NsT^" ij'n.k ty^ {2,t Tn.k ^n,k'^n,k + ^n,fc 3 1 ) {j'n,k ~\~ ln,k 2 1 ) 

^ \i n.k I'n^k } 

TTT- ^^—Tsj2{t - ln,kf (3r„,fc + ln,k - 4 * t) (r„ ^ + -2t) 

~ 6(r„fc^,fc)5/2 (^n.,fc - i)^ (3/„,/fc + - 4* t) (r„^fc + -2t) 



ill 

^3 ('^2 



,,^i^,yo/2 irn,k - t)^ - 7 r„,fc t + 5 ln,k rn,k - 25 1 Z„,fc + 16 + 10 Z^^^- ) 



6 {r„ j.-/„ fe)572 ~ ln,k) (3 T^^fc + 2 — 5 t) + 2 — 3 

^ ^5/2 (^n.fc - t)^ (3 ln,k + 2 r„,fc - 5 1) {ln,k + 2 r„,fc - 3 1) 

"qJ^. JTI] ^_)5/2 ^n,k)' (2 t '"n,fc ln,k1"n,k ~l~ ^n,fc 3 {Tn,k ~\~ ^n^k 2 t) 

' g"(7 ^TI] ^■)5/2 ('"n,fc ~ ^)'^ (2 t — r^^fc — ln,k'fn,k + ^n,fc ~ 3 t)^ (j"?!,*; "I" ln,k ~ 2t) 

^ dt-ln,k){K,k 

„2 



^ ^5/2 (^n,fc - i) (4 r-^ fc - 17 1 r„,fc + 9 ln,k rn,k - 15 1 ln,k + 3 + 16 1 

"J V n.k ''n,k ) ^ ' 



-^{l-t) {r + l-2t) (r + 4/-5t) 
t) (r + /-2t) (/ + 4r-5t) 



(,._i)5/2 



^^^-^^372 (/ - t) (19 /2 - 56 / 1 + 18 / r - 24 1 r + 3 + 40 1^) 
— ^ (r - t) (19r2 - 56rt + 18/r - 24i / + 3/^ + 40t2) 



Notice again that the basis functions satisfy the relationships: 
dt 



{lpn,k)i,j{t)) = {lpn,k)i+l,j{t) 



for i G {1,2} and j £ {1,2,3}. These functions also form a tri-orthogonal 
basis of functions, which makes easy to simulate sample paths of the doubly 
integrated Wiener process, as show in Figure 4. 
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Fig 4. (A) Basis for the construction of the Doubly Integrated Wiener process (d 
and (B) lO-steps construction of the process. 
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APPENDIX C: PROPERTIES OF THE LIFT OPERATORS 

This appendix is devoted to the proofs of the properties of the lift operator 
enumerated in Proposition 19. The proposition is spht into three lemmas for 
the sake of clarity. 

Lemma 9. The operator a,pG is a linear measurable bijection. Moreover, 
for every N > 0, the function a,i3GN = Pn ° afiG o : ^Vl'^ is a 

finite- dimensional linear operator, whose matrix representation is triangular 
in the natural basis of ^fl^ and whose eigenvalues a,i3'^n,k olt^ given by 

a,l3l'n,k = — 7 ^ , 0<n< N, 0<k<2 

gi3{mn,k) aMn,k 

Eventually, a,i3G is a bounded operator for the spectral norm with 

II ^11 . SUp5ra SUp//3 sup/2 
U,/?*^ = SUpSUp„,/3l/„,fc < — —— . „ < OO, 

" n k mffi-/? mf/ mf/j 

and the determinant of a,i3GN denoted a^pJN admits a limit when N tends 
to infinity 

lim det (a,/3GAr) = lim a,i3JN=ex.p(l-( (a(t) - /3(t)) ) ) = a,/3^ • 
N^oo N-¥oo \2 \Jq J J 

Proof. All these properties are deduced from the properties of the func- 
tions A and ^ derived previously. 

i) a,i3G = pA o q;^' is a linear measurable bijection of ^il.' as the composed 
application of two linear bijective measurable functions q,A : — ^ and 

a) Since we have the expressions of the matrices of the finite-dimensional 
linear transformations, it is easy to write the linear transformation of a,i3GN 
on the natural basis e„ fc as: 
(C.l) 

o.,pGn iOn,k = [ P<k{t){a'fiO)it) dt= [I f^<k{t) ai^p,q{t) dt] i, 

(p,(j)eXjv 

leading to the coefficient expression 
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where we have dropped the index since the expression of the coefficients 
do not depend on it. We deduce from the form of the matrices /jA^v and 
a^N, that the apphcation a,iiGN has a matrix representation in the basis 
e„, k of the form 



a,l3GN 















a,/3'-^l,0 










a,/3'-^2.0 
a,/3'-^2,l 


a,/3'-^2,0 

r«2,i 

a,/3<-^2,l 






a,/3'-'3,0 
^0,0 

^0,0 
a,/3'-^3.2 

^o;o 

a,/3'-"3,3 


a,/3'-^3,0 

a,/3'-^3,l 
^1,0 
a,/3'-^3,2 

a,/3'-"3,3 


^2,U 
a,/3'-^3,0 

^2,0 
a,/3'-^3,l 

^^2,1 
a,/3'-^3,2 

r<2,i 

«,/3'-^3,3 


^3,0 
a,^'-^3,0 

a,/3'-^3,l 

^3,2 
a,/3'-"3,2 

^3,3 
a,/3'-^3,3 















where we only represent the non-zero terms. 

The eigenvalues of the operator are therefore the diagonal elements q,/?^^ ^, 
that are easily computed from the expressions of the general term of the ma- 
trix: 



r<n,k 



P^n,k°''^n,k 

pMn^k Qaimn^k) 



9l3{mn,k) aMn,k 
gajmn^k) l3Mn,k 
a 



in) From the expression of Q-M^i^fc = \/ {ha{r) — ha{'m)){ha{ni) — ha{l)) / {ha{r) 
we deduce the inequalities 



K{1)), 



(C.2) 



inf/2 "''^-inf/l 



from which follows the given upper-bound to the singular values. 

iv) a,iiGN is a finite-dimensional triangular linear matrix in the basis {e^^fc}- 

Its determinant is simply given as the product 



N 



N 



(C.3) a,/3JAf = W a./^G'nifc = n JI a,l3l^n,k , 

n=0 0<fc<2"-i n=0 0<k<2"-^ 
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where we noticed that the eigenvalues a,p^n,k are of the form 



k) aMnh 



Since for every > 0, we have a,iiGN = c/s^'ato^^Gat which entails a,i3JN 
cpJn • icaJw)'^ , it is enough to show that we have 

1 

lim a qJn = exp - / a{t) dt . 
Now, writing for every < s < t < 1 the quantity 



t,s 



r(n) e^/^^^^-^^dTx. 



we have 



SO that, afiJN is a telescoping product that can be written 

2iv 



a"l^fc2-JV,(fc+l)2-JV 



fc=0 0'^fc2-JV,(fc4.l)2-JV 

If Q is Holder continuous, there exists 5 > Q and C > such that 

\a{t) — a{s)\ 



sup 

0<s,t<l 



\t - 

and introducing for any < s < t < 1, the quantity Q^^, 



Q 



Us = e 



Jl T{u) e-fu "^^-r ''^ 



we have that ^ < Qt,s < Qt,s with 



2m 



— and Qt,s = ^ ^ 



r(n) ' /J r(n) du 

After Taylor expanding the exponential in the preceding definitions, we have 
2C(supo<t<ir(t)) 



t,s 



> 1 



< 1 + 



info<t<ir(i) (l + 5)(2 + 5) 
2C(supo<,<ir(t)) (t-g)(i+^) 
info<f<ir(i) (l + 5)(2 + 5) 
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Now, from 

2N 

n Qfc2-^,(fc+l)2-^ =1 + (2"^) 
fc=0 

we can directly conclude that 



lim o^oJn = e^o "W'^* 



2iv 

1 Jo' a{t) dt 



lim Yl Qfc2-^,(fc+l)2-^ = 6 2 



Ar-s>oo 

fc=0 



□ 



Notice that if a = /3, a^aG is the identity and a,aJ = 1 as expected. 
Similar properties are now proved for the process lift operator a,/3H. 

Lemma 10. The function a,i3H is a linear measurable bijection. 
Moreover, for every N > 0, the function a,i3Hiy = Pn o a,i3H o Ijy : x^'n ~^ 
x^N is a finite- dimensional linear operator, whose matrix representation is 
triangular in the natural basis of x^n o-nd whose eigenvalues are given by 

ga{mn,k) pMn^k 

Eventually, a,(sH is a bounded operator for the spectral norm with 

II u-ll II ^11 . SUP5/J sup/ sup/| 

n k ' mt ^Q, mt J 13 mt 

and the determinant of a.pH^ admits a limit when N tends to infinity 



lim det {a,f}H) = exp ( ^ ( / 



{p{t)-a{t))dt] =^,„J. 



Proof, i) The function a,iiH = p'^ o q,A is a linear measurable bijection 
of x^' onto x^\ because qA : x^' and q,^' : ^0,' — )• x^' are linear 

bijective measurable functions. 

a) We write the linear transformation of a,i3H for x in x^' as 



(C.4) a,l3H[x]{t) = ^ I3i^n,k{t) i a5n,k{s) x{s) ds 

in,k)£l •'^ 

= / I3'^n,k{t)a5n,k{t)\ x{t) dt 

■'^ \(n,fc)eX / 
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If we denote the class of x in by x = {xij} = {x{mij)}, G In, we 
can write (C.4) as 



E 



AP,q 



from which we deduce the expression of the coefficients of the matrix a,i3Hi\j 

(p,(?)eX]v 

where as usual we drop the index N . Because of the the form of the matrices 
a^N and /3^Ar, the matrix a^pH^ in the basis /jj has the following triangular 
form: 



a,l3HN 



Q./3-"0,0 










o-U,U 


H-i,0 








o-0,U 

0-0,0 
a,/3-"2,l 


oi,0 

a,/3-"2,0 
H-1,0 
a,/3-"2,l 


0^,0 
a,/3-"2,0 

0-2,1 
a,/3-n2,l 






0-0,0 
a,/3-"3,0 

0-0,0 
a,/3-^3,l 

oO,0 
a,/3-"3,2 

o,/3-"3,3 


H-i,0 
a,/3-"3.0 

H-i;o 
H-i;o 

a,;S-"3,2 
a,0-"3,3 


0-2,0 
a,/3-"3,0 

o2,0 
a,/3^3,l 

o2,l 
«,^-"3,2 

o2,l 
a,/3-"3,3 


0-3,0 
a,/3-"3,0 

o3,l 
a,/3-W3,l 

0-3,2 
a,/3-"3,2 

o3,3 
a,/3-"3,3 















From the matrix representation and the diagonal terms of a,/3-f^ 
read: 

9a{mi,j) 9a{m,j) isM, 



«J — 7, — ,/ -1 



iiij The upper-bound directly follows form the fact that (s,at^i,j = ia,i3'^i,j)~^ ■ 
iv) Since i3,ai^i,j = the value of the determinant oi a^pH^ is clearly 

the inverse of the determinant of afiGN-, so that limTv^-oo '^^^{a^pH n) = 

Note that lemma 10 directly follows from the fact that q,^ and are 
inverse from each other and admit a triangular matrix representation. 

APPENDIX D: CONSTRUCTION AND COEFFICIENT 

APPLICATIONS 

In this appendix we provide the proofs of the main properties used in the 
paper regarding the construction and the coefficient applications. 
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D.l. The Construction application. We start by addressing the 
case of the construction application introduced in section 2.2.1. 
We start by proving Theorem 8 

Proposition 22. For every ^ in^Q' , ^'^(^) converges uniformly toward 
a continuous function in Co([0, IJjIR'^). We will denote this function 
defined as: 

^ Ln' ^Co([o,i],M'^) 

and this application will he referred to as the construction application. 

Proof. For the sake of simplicity, we will denote for any functions A : 
[0, 1] — )• M™'^'^, the uniform norm as |A|oo = supg<;(<;]^ where = 

supo<j<m (Z^o"^ is the operator norm induced by the uniform 

norms. We will also denote the i-th line of A by li{A) (it is a M*^- valued 
function) and the j-th column of A by Cj{A). 

Let ^ G ^Q' fixed. These coefficients induce a sequence of continuous func- 
tions ip'^ {$) through the action of the sequence of the partial construction 
applications. To prove that this sequence converges towards a continuous 
function, we show that it uniformly converges, which implies the result of 
the proposition using the fact that a uniform limit of continuous functions 
is a continuous function. Moreover, since the functions take values in 
which is a complete space, we show that for any sequence of coefficients 
^ G ^Q,', the sequence of functions (t) constitute a Cauchy sequence for 
the uniform norm. 

By definition of ^0', for every ^ in ^0', there exist 6 < 1 and such that, 
for every n > n^, we have 

sup < 2^ . 

0<fc<2"-i 

which implies that for N > n^, we have 

(n,fc)eX]v\Inj 
oo 

(D.l) < 2"'^'lV'n,fc|. 

n=n^ 
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We therefore need to upperbound the uniform norm of the function ipn,k- 
To this purpose, we use the definition of tpn,k given by equation (2.7): 

i/'n,fc(i) = 9{t) ■ /o fis) ■ *„,,fc(s) ds . 

The coefficient in position of the integral term in the righthand side 
of the previous inequahty can be written as a function of the fines and 
columns of / and $n,fc) and can be upperbounded using the Cauchy-Schwarz 
inequality on L'^{[0, 1],M"') as follows: 

(l[0,t] • Ci(/^),Cj(0n,fc)) = / ^lO,t]nS„kis){h{f){s) ■ Cj{(l)n,k){s)) ds 

Ju 

< I|l[0,t]n5„,fc ^i(/)l|2 \\cj{(t)n,k)h- 

Since the columns of $n,fc form an orthogonal basis of functions for the stan- 
dard scalar product in L^([0, IJjM'^) ( see Proposition 5), we have ||cj(0„^fc)||2 = 
1. Moreover, since / is bounded continuous on [0, 1], we can define constants 
Ki = supo<«x < °o and write 

l|l[o,t]ns„,4(/)lP = / lmns„,{s){k{f){sf ■k{f){s))ds 

Ju 

< [ l[o,t]ns„,,{s)Kfds 
Ju 

Setting K = maxo<i<rfi^i, for all (n, k) in I, the M'^^'^-valued functions 

l^n,kit) = / l[O,t](s)/(s)0n,fc(s)rfs, 

Ju 

n-\~ 1 

satisfy ||K„,fc||oo = supo<j<i |Kn,fc(i)| < K2 2 . 

Moreover, since g is also bounded continuous on [0, 1], there exist L such 
that \\g\\oo = supq<j<]^ |9'(*)I < L, and we finally have for all < t < 1: 

n + l 

||'«/'n,fc||oo < ||fl'||oo||'^n,fc||oo < -Z^-fi^ 2 2 . 

We now use this bound and equation (D.l), we have: 
(D.2) 
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and since 6 < 1, for the continuous functions 1 1— t- {^) forms a uniformly 
convergent sequence of functions for the d— dimensional uniform norm. This 
sequence therefore converges towards a continuous function, and ^ is well 
defined on ^Q' and takes values in Co([0, IJjM'^). 

□ 

This proposition being proved, we dispose of the map ^ = lim7v-5.oo 
We now turn to prove different useful properties on this function. We de- 
note B (Co([0, 1],M'^)) the Borelian sets of the d-dimensional Wiener space 
Co([0,l],M'^). 

Lemma 11. The function^ : {^n' , B {^Q')) ^ (C7o([0, l],M'^),i3 (C7o([0, 1],M'^))) 
is a linear injection. 

Proof. The application ^ is clearly linear. The injective property simply 
results from the existence of the dual family of distributions Sn^k- Indeed, 
for every ^, ^' in ^0', we have ^{(,) = ^{S,') entails that for all n, k, ^„,^fc = 

In the one-dimensional mentioned in the main text, because the 

uniform convergence of the sample paths is preserved as long as a is con- 
tinuous and r is non-zero through (D.2), the definition does not depend 
on a or r, and the space x^' is large enough to contain reasonably regular 
functions: 

Proposition 23. In the one- dimensional case, the space ^i}' contains 
the space of uniformly Holder continuous functions H defined as 



H= {x£ C[0, 1] 



\x{t) — x{s)\ 

do > 0, sup j — < +00 

o<s,t<i \t - sr 

Remark 8. This point can be seen as a direct consequence of the char- 
acterization of the local Holder exponent of a continuous real function in 
term of the asymptotic behavior of its coefficients in the decomposition on 
the Schauder basis [14]. 

Proof. To underline that we place ourself in the one-dimensional case, 
we drop the bold notations that indicates multidimensional quantities. Sup- 
pose x is uniformly Holder continuous for a given 6 > 0, there always exist 
^ such that *I'^(^) coincides with x on Dn: it is enough to take ^ such that 
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for all (n, k) in X^v, Cn,A: = {^n,k^ We can further write for n > 

x{mnk) ( J x{lnk) jj x{rnk) 
[X,dn,k) = Mn,k—, ^ — I -L^n.fc n' \ ^ -^".^ 



g{mn,k) V ' 9a{l n,k) 9vn,kj 

f x{mn,k) x{ln,k)\ , D (x{mn,k) x{rn,k) 
W,k —f T Ti T + ^n,k 



g{mn,k) g{ln,k)j ' \g{mn,k) g{rn,k) 

For a given function a, posing Na = ^i^'^^l^l p(t) ' have 

Ti + l n— 1 n — 1 

aMn,k <Na2— , ^Ln,k < iVa 2" , aRn,k < A^a 2" . 

Moreover, if a is in H, it is straightforward to see that has a continuous 
derivative. Then, since x is (5-Holder, for any e > 0, there exists C > such 
that |t — s| < e entails 

x{t) x{s) 



git) gis) 

from which we directly deduce 



< Ce" 



This demonstrates that {^n,fc} belongs to ^f]' and ends the proof. □ 

We equip the space x^' with the topology induced by the uniform norm 
on Co([0, 1],M'^). As usual, we denote B{x^') the corresponding Borelian 
sets. We now show Proposition 9 

Proposition 24. The function * : (^fi', 5 (^$7')) {x^',B{x^')) is a 
bounded continuous bijection. 

Proof. Consider an open ball xB{x,e) of x^' of radius e. If we take 
M = LKj^ as defined in (D.2), we can choose a real 5 > such that 



b<eMVY^ 2"" 



/2 

n=0 



Let us consider ^ in such that ^(^) = x. Then by (D.2), we immediately 
have that, for all ^' in the ball of radius i^B{i, S) of fl, ||*(| - |')lloo < £• 
This shows that ^'^^(;x.i?(x, e)) is open and that ^ is continuous for the 
d— dimensional uniform norm topology. □ 
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D.2. The Coefficient application. In this section of the appendix 
we show some useful properties of the coefficient application introduced in 
section 2.2.2. 

LEMMA12. The function A : (Co([0, IJ.K'^),^ (Co([0, -^{^n,B{^n)) 
is a measurable linear injection. 

Proof, i) The function A is clearly linear. 
a) To prove that, A is injective, we show that for x and y in Co([0, 1],M'^), 
X ^ y implies that A(a3) / A(?/). To this end, we fix a; 7^ y in Co([0, 1], M'^) 
equipped with the uniform norm, and consider the continuous function 

{n,k)£Xff 

This function coincides with x — y on every dyadic numbers in Djsf and 
has zero value if A(ic) = A(2/). Since x ^ y, there exists s in ]0, 1[ such 
that x{s) 7^ y{s), and by continuity of x — y, there exists an e > such 
that a; 7^ y on the ball ]s — e, s + e[. But, for N large enough, there exists 
k, < k < 2^~^ such that \s — k2^^\ < e. We then necessarily have that 
A(/) / A{g), otherwise, we would have dN{k2-^) = {x - y){k2-^) = 0, 
which would contradict the choice of e. 

Hi) Before proving the measurability of A, we need the following observa- 
tion. Consider for > 0, the finite dimensional linear function Aat 

Co([0,l],M'^) (m'^) 

X I > An{x) = {A{x)N,k][N,k)(iXt^ ■ 

Since for all {N, k), the matrices Mj\[^kj RN,ki Lj^^i^. are all bounded, the func- 
tion An : (Co([0,l],M^),^(Co([0,l],M'^))) ^ ((M'^)'"'"', 5 ((M'^) 
is a continuous linear application. To show that the function A is measur- 
able, it is enough to show that the pre-image by A of the generative cylinder 
sets ofBi^n) belong to B {Co{[0,l],R'^)) . 
For any > 0, take an arbitrary Borel set 

(D.3) B= II Bn,k G B ({^'^y'') , 

{n,k)&XN 

and define the cylinder set Cn{B) as 



Cn{B) = G 



V (n, k) € In , $n,k G Bn,k 
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and we write the collection of cylinder sets C as 

C = y Ctv with Cn= (j Cn{B) . 

We proceed by induction on to show that the pre-image by A of any 

cylinder set in C is in i3(Co([0, 1],M'^)). For N = 0, a cylinder set of 

Co is of the form Bo,o in B{M.'^), A-^{B) = {x e Co([0, 1], M^) | £c(l) G 

-^o'o fl'~"^('"o,o) {Bofl)}, which is measurable for being a cylinder set of (Co([0, 1], M*^)) . 

Suppose now that for > 0, for any set A in Cat-i, the set A.~^{A) is mea- 

surable. Then considering a set A in Cj,, there exist B in B {{R^f^) such 

that A = Cn{B). Define A' in Cn such that A' = Cn~i{B'), where 

B' = JJ i?„,fc . 

{n,fc)eljv-i 

and remark that A = Cn{B) G A' = Cn{B'). Clearly, we have that A = 
A' r\ D, where we have defined the cylinder set D as 

\(7V,fc)eXiv,fe 

Having defined the function A^v, we now have have A~^(A) = A^"'^(yl' n 
D) = A-i(A') n A-i(D) = A~^{A') n A-^(D). Because of the conti- 
nuity of Aat, A^^(Z)) is a Borel set of 5 (Co([0, 1],M'^)). Since, by hy- 
pothesis of recurrence, A"^(^') is in B (Co([0, 1],M'^)), A~^(A) is also in 
B [Cq[[Q,1\,W^)) as the intersection of two Borel sets. The proof of the 
measurability of A is complete. □ 

We now demonstrate Proposition 10. 

Proposition 25. The function A : {x^' ,B {x^')) (^0', 5 (^il')) « 
measurable linear bijection whose inverse is ^ = A^^. 

Proof. Let x € x^' be a continuous function. We have: 

(n,fc)eX 
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This function is equal to x{t) for any t ^ D the set of dyadic numbers. 
Since D is dense in [0,1] and both x and ^(A(x)) are continuous, the 
two functions, coinciding on the dyadic numbers, are equal for the uniform 
distance, and hence *(A(x)) = x. □ 

APPENDIX E: ITO FORMULA 

In this section we provide rigorous proofs of Proposition 17 and Theorem 
18 related to Ito formula. 

Proposition 26 (Integration by parts). Let {Xt) and (It) he two one- 
dimensional Gauss-Markov processes starting from zero. Then we have the 
following equality in law: 

XtYt= I XsodYs+ f Y.odX, 
Jo Jo 

where AgodBg for At and Bt two stochastic processes denotes the Stratonovich 
integral. In terms of ltd 's integral, this formula is written: 

XtYt= [ XsdYs+ [ YsdXs + {X,Y)t 
Jo Jo 

where the brackets denote the mean quadratic variation. 

Proof. We assume that X and Y satisfy the equations: 

dXt =axit)Xt + y^T^dWt 
dYt = ay{t)Xt + ,/T7(f) dWt 

and we introduce the functions fx, fy, gx, gy such that Xt = gx{t) Jq fx{s) 
and Yt = gy{t) Jq fy{s) . 

We define {x'(pn,k){n,k)ex^^^ (yV'n,fc)(n,fc)ex the construction bases of the 
processes X and Y. Therefore, using Theorem 11, there exist {x'^n,k){n,k)£X 
and (y"p,q){p,g)6x standard normal independent variables such that X = 
J2{n,k)&xx'>Pn,k ■ x'^n,k and Y = 'E(p^q)(zXY^n,k ' y^n,k- and we know that 
the processes X and Y are almost-sure uniform limits when — t- oo of the 
processes X^ and Y^ defined as the partial sums: 

X^ = ^ x1pn,k ■ x'^n,k and Y^ = ^ y1pn,k ' y'^n,k- 
{n,k)&XN (p,q)&XM 
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Using the fact that the functions xi^n,k and Yi^n,k have piecewise continuous 
derivatives, we have: 

(n,fc)6/jv {p,q)&lN 

ft 



f d 

x'^n,k Y'^p,q ixll^n,k{s)Yfpp,qis)) dt 

,fc)G/iv {p,q)elN ° ^ 

xEn^kY^p,q f {x^n^k{s)Y'>Pp,q{s) + xi^n,k{^)Y^p,qi^)) ds 



{n,k)&lN {p,q)&lN 

Therefore we need to evaluate the piecewise derivative of the functions xipn,k 
and Y'4'n,k- We know that 

1 f x4'n,k\ / X , /X 

[tj = x(Pn,k[t) 



fx V 9x 

which entails: 

x'iPn,k = x1pn,k + 9x fx x4'n,k = 0!xxll^n,k + x(pn,k 
and similarly so for the process Y. Therefore, we have: 



yN -w-N I Dfi,fc _i_ /^n,k , r)n,k 



with 



At = Y, ( / (^x{s) xi'n,k{s)Ylpp,q{s)ds\ x'En,kY'Ep,q 

(n,k)(ilN (p,q)elN ^ ° ^ 

Bt = Y X] ( / V'^x{s)x4>nM^) Y'4^p,q{s) ds j xSn,fc yHp, 

= ^ yZ [ I (^Yis) x1pn,k{s)Y'>Pp,q{s)dsj x'En,kY'Ep,q 

{n,k)elN {p,q)elN ^ ° ''^ 

A = Yj X] ( / \/ry(s) y0n,A:(s) xV'p,g(s) j dSx'^n^k Y^-p, 



{n,k)el]^ {p,q)elN 

We easily compute: 



At + Ct= f{ax{s) + aY{s))X''{s) y^(s) ds. 
Jo 
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For t G [0,1] as it is our case, {s) and {s) are both almost surely 
finite for all t in [0, 1]. For almost all and yi drawn with respect to the 
law of the Gaussian infinite vector H, we therefore have, by the Lebesgue's 
dominated convergence theorem that this integral converges almost surely 
towards ^ 

/ {ax{s) + ay{s))X{s)Y{s)ds. 
Jo 

The other two terms Bt and Dt necessitate a more thorough analysis, and 
we treat it as follows. Let us start by considering the first one of this term: 

-Bf = y l[0,t](s)\/rx(s) ^ ^ x4'n,ki^)Ylpp,qis) x'^n,kY'^p,qds 
^ {n,k)elN {p,q)elN 



E 

keVN\{ 



t»ei'iv\{i}-'* 



1} \(ri,fc)G: 



f0n,fc(s) • x^n,k I Y'^{s)ds 



ti+l 



1 



fx{s) V 9x 



X 



N 



Let us now have a closer look at the process X/^ for t € where 
= Sjy^i for i such that {N,i) E I. Because of the structure of our 
construction, we have: 
(E.l) 



and 
(E.2) 



ffy(t) hyitj + l) - fey(t) ^ ^ gy(t) hY{t)-hY{ti) ^ 

gY{ti) hyiti+i) - hY{ti) Qy (ti+l) hy (ti+l) - hY{ti) 

/x(t) / ^> 



1 



iV 



it) 



fx{t) V to 
We therefore have: 

/ l[o,t](^)\/rrM d (X^{s) 



X. 



fx{s) ds V gxis) 



ti 



hx{ti+i) - hx{ti) \gxiti+i) 9x{ti) J ' 



Y^is)ds 

/ty(ti+l) - /ly(s) If, 
/ly(ti+l) - /ly(ti) 5y(tj) 



+ ^^^^^ 

hY{s)-hY{ti) lf,_^i 
hY{ti+i) - hyiti) gY{ti+i) 



+ 



ds 



X, 



ti + l 



X, 



Xf ■ , , 
9x{ii+i 



9 X (ti+l) 9x{ti) 

Xt- 
9x{ti 
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with 

* Ju hx{ti+i) - hx{ti) gviti) hriti+i) - hyiti) 

^jv/^) _ /•*'+^ 9y{s) hy{s)-hy{U) 

' Ju hx{ti+i) - hx{ti) gYiU+i) hyiti+i) - hyiti) 

Let us denote 6^ the time step of the partition 5j\i = max4^g-p^\^|x}(ti+i — ti), 
which is smaller than with p G (0, 1) from the assumption made in 
section 1.2.1. Moreover, we know that the functions gx, gv, hx and hy 
are continuously differentiable, and since y/Tx and y/Ty are (5-Holder, so 
are fx and fy. When N ^ oo (i.e. when 5^ ^ 0), using Taylor and Holder 
expansions for the differential functions, we can further evaluate the integrals 
we are considering. Let us first assume that t > t^+i. We have: 

^,(t)^= f'^^' V^is)fx{s) gyjs) hyjti+l) - hyjs) 

Ju hx{ti+i) - hx{ti) gy{ti) hy{ti+i) - hy{ti) 

^ Vr^iu){i + o{5f,))fx{u){i + o{5j,)) 

fxiti)Hti+i-U){l + 0{6N)) 
gyiU){l + Oi5N)) fy{uf{ti+i-s){l + 0{5N)) 



gviU) 4 fy{tif iU+i - ti){l + Oi6N)) 

rl(ti) / ti+i - s 



fx{ti){ti+l — t 



Similarly, we show that that wi^ (t) = i^dxiti) + 0{5n + 5^) when iV — oo. 



If t < tj, we have vf^(t) = w^{t) = and for t in [tip, tip + 1) we have: 



We then finally have: 



ti&'Disi; ti^i<t 



Uo+i-UoJ ^ ° ^ \gx[t) gxiUJ 
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Moreover, we observe that the process Xt/gx{t) = //.'^^ fx{s) dWg is a mar- 
tingale, and by definition of Stratonovich integral for martingale processes, 
we have: 

Bt f gx{s)Ys o d {Xjgxis)) = f v^(s)y, o dW{s) 

where o is used to denote the Stratonovich stochastic integral and the limit 
is taken in distribution. Notice that the fact that the sum converges towards 
Stratonovich integral does not depend on the type of sequence of partition 
chosen which can be different from the dyadic partition. Putting all these 
results together, we obtain the equality in law: 

ft 



XtYt = [ ax{s)X,Ysds+ [ y^is)YsodWs + 
Jo Jo 

[ ayis)XsYsds+ [ y^is)XsodWs 
Jo Jo 



which is exactly the integration by parts formula we were searching for. The 
integration by parts formula for Ito stochastic integral directly comes from 
the relationship between Stratonovich and Ito stochastic integral. □ 

Theorem 27 (Ito). Let X be a Gauss- Markov process and f in C^(M). 
The process f{Xt) is a Markov process and satisfies the relation: 



(E.3) f{Xt) = f{Xo) + f f'{Xs)dXs + \ f f"{X, 

Jo ^ Jo 



)d{X), 



Proof. The integration by parts formula directly implies Ito's formula 
through a density argument, as follows. Let A be the set of functions / G 
C^([0, 1],K) such that equation (E.3) is true. It is clear that ^ is a vector 
space. Moreover, because of the result of Proposition 17, the space A is 
an algebra. Since all constant functions and the identity function f{x) = x 
trivially belong to A, the algebra A contains all polynomial functions. 

Let now / G C^([0, 1],M). There exists a sequence of polynomials such 
that Pk (resp. Pk, Pi!) uniformly converges towards / (resp. /', /"). Let us 
denote Un the sequence of stopping times 

Un = mf{te [0,1] ; \Xt\ >n}. 

This sequences grows towards infinity. We have: 

Pk{Xt;,uJ-Pk(.Xo) = f Pl{Xs)l^Q^u„]is)dXs+l f P;;{Xs)lio.u„]{s)d{X)s 
Jo ^ Jo 
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On the interval [0,[/„], we have Xt < n, which ahows to use Lebesgue's 
dominated convergence theorem on each term of the equahty. We have: 



E 



( P!,{Xs)lio.uJs)dXs- [ F'{Xs)lio.uJs)dXs 
Jo 



E 



\P;,{X,) - F'{Xs)\' l[o,u„]{s)d{X), 



which converges towards zero because of Lebesgue's theorem for Steljes in- 
tegration. The same argument directly applies to the other term. Therefore, 
letting fc — )■ oo, we proved Ito's formula for XtAUn^ eventually letting 
n — )• oo obtain the desired formula. □ 



APPENDIX F: TRACE CLASS OPERATOR 

In this section, we demonstrate the Theorem 20, which proves instrumen- 
tal to extend the finite-dimensional change of variable formula to the infinite 
dimensional case. The proof relies on the following lemma: 



Lemma 13. The operator a,(5S — Id : P{M.) —?■ P{M.) is isometric to the 
operator a^pR '■ /^(K) — )• /^(M) defined by 



(F.l) 

with the kernel 



,^l3R{t, s) x{s) ds , 



,^R{t, s) = {a{t V s) - /3(t V s)) + U^) 



1 {ain)-l3iu)f 



tVs 



du fais) . 



Proof. Notice first that 



a{t V .) - (3it V .)) = 1|,<,| {a{t) - /3(t)) Mf) + i^^^^^ _ p^s)) .^"^^^ 



UtVs) ^^^^^^ Ut) 
which leads to write in L^[0, 1], for any (n, k) and (p, q) in X 



Us) ' 



{a(kn,k, a,fiR[a(t>p,q]) = [ [ a,pR{t, s)„</>„,fc (t)„0p,5(s) dt ds = ^JJ'^ + B"^^^ + C^^^ , 

JO Jo 
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with 

^n,k ^ ,^ a(t) - /?(t) , , f J^VJ, dt. 



fait) 

^ a{t) - /3{t) 
1 



Y4>n,k{t)a'4'p,q{t)dt , 

1 a(s) -/3(s) 



^ a{t) - (5{t) , , , ^ , , , 

Wn,k\t)a(Pp,q\t)dt , 



\/rW 



and 



1 ri 




a{u) - P{u)) 



2 



Cp'q = / / a(t}n,k{t)fa{t)\ / ^ -^^-—^du\f{s)a(l)p,q{s)dtds 



^0 

1 (a(n) -/3(n)) 



JO JO 



(l[0,«](0/Q(Oa'/'n,fc(i)) (l[0,n](s)/Q(s)Q(/>p,g(s)) dt ds du , 

1 (a(n)-/3(^/))' 



r(u) 



■ ai^n^kif) a-4}p,q{t) dt ds . 



This proves that (ai;^n,A;5 a,/3-R[a';^p,i3]) = [a,/?'? — -^c?]p'g • Therefore, if we denote 
the isometric hnear operator 

: /2(M) — y l2(]R) 

oo 

a4'n,k ' ^n,k i 

n=0 0<A;<2"-i 

we clearly have ° a,/3-R ° = a,/3'S' — Id with = a^^^- □ 

We now proceed to demonstrate that a,i3S — Id is a trace-class operator. 

Proof of Theorem 20. Since the kernel a,pR{t: s) is integrable in -L^([0, 1] 
[0,1]), the integral operator a,i3R ■ -^^[0,1] — )• L^[0, 1] is a Hibert-Schmidt 
operator and thus is compact. Moreover it is a trace-class operator, since we 
have 

■ "1 {a{u)-^{u)y ^ 



TrU,f}R) = I {a{t)-m)dt + fj{t)yj^ ' ^ 2(^j ds j dt 
{a{t)-m) dt+ [' M)_{a{t) - dt 

Jo fa{t) 
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Since ^^pS — Id and a^pR are isometric through the compactness of 
a^f^S — Id is equivalent to the compactness of a,/3-^- Moreover the traces of 
both operator coincide: 



= X] X] / / a(f>n,k{'^)a(t^n,k{s)a,l3R{t,s)dsdt, 
n=0 0<fc<2"-i n=0 0<fc<2"-i ^ ° 

= / / X ^ a'/'n,fc(i)a'/'n,fc(s) a,/3R{t, s) ds 
■^0 -^0 yn=0 0<fc<2"-l / 



1 

a^f^Rit, t) ds dt , 



using the result of Corollary 2. □ 

APPENDIX G: GIRSANOV FORMULA 

In this section we provide the quite technical proof of Lemma 8 which is 
useful in proving Girsanov's formula: 

Lemma 14. The positive definite quadratic form on /^(M) x P{M.) associ- 
ated with operator a^S — Id : /^(M) — t- Z^(M) is well-defined on ^Q! . Moreover 
for all jfi', 



1 ait) - m MO ^ ^ (aXtm ^ {a{t)-m) ( aXtm ^ 



Pit) 9a{t) V gUt) J Jo Pit) V 9ait) 

where a^tiO = a^{£,) o-'^d o refers to the Stratonovich integral and the 
equality is true in law. 

Proof. The proof of this lemma uses quite similar material as in the 
proof of Ito's theorem. However since this result is central for giving insight 
on the way our geometric considerations relate to Girsanov's theorem, we 
provide the detailed proof here. 
Consider ,^ in ^1)', denote ^at = ^Pn{^,) and write 

{(.N, ia,l3SN - Id^nM)i^N)) = X X ("^M + ^"''^ ^P'? 

(n,A;)eXiv {p,q)&XN 
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where we have posited 

Jo vr(i) 

It is easy to see, using similar arguments as in the proof of the integration 
by parts formula, Proposition 17: 

Jo ^/Tit) fc'it) dt\ gait) J ' 

and 

(n,fc)eiiv (p,g)eXiv ° ^ 

Because of the uniform convergence property of X'^ towards X and the fact 
that it has almost surely bounded sample paths, the latter sum converges 
towards 

-1 {a{t)-mf f aXtm \, 

Pit) [gUt) ) 

Now writing quantity i^) as the sum of elementary integrals between the 
points of discontinuity tj = i2~^ , < i < 2^ 

.iv..^ _ o f'^' - m gxm d faXim . 

^^^" ^4 -l(^dt[-^)'^'^ 

and using the identities of equations (E.l) and (E.2), we then have 

2-'^— 1 

/l^rn - _9 /^,,Ar a^t.(0 jy a-^tj+i (0 \ / aXt^i() \ 

where we denoted 

//.'+^ (a(t) - - hit)) dt 



..N 



{hiti+i) - hiti)) 



2 



^ _ {ait)-m)[Kk+i)-hit))dt 
{hit,+i)-hit,)f 
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Let us define the function w in C[0, 1] by 

a{t) - (3{t) 



wit) 



Pit) 



If a and /3 is uniformly J-Holder continuous, so is w. Therefore, there exist 
an integer A^' > and a real M > such that if N > N', for all < i < 2^, 
we have 















- w{ti) 










Ju 



{w{t) - W{ti)) 



|((Mtm)-Mt))- 
{h{ti+i) - h{ti))^ 



dt 



< M 



^i({h{t,+,)-h{t))') 
- U)^ 



dt 



t.+i {t-t,Y+^ {hit,+i) - h{t)Y 
u ^ + ^ {h{t,+i) - h{t,)y 
it - t,Y+^ 

2{5 + l){6 + 2) 



N 
i+l 



which shows that for \wf — w{ti)\ = 0{2 ^i'^+^))^ and similarly 
w{ti^i)\ = 0{2~^^^^^^) as well. As a consequence, expression (G.l) con- 
verges when A^ tends to infinity toward the desired Stratonovich integral. □ 
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